Octoparse icon

Octoparse

Interact with Octoparse API

Data → Get Data by Offset

AI-generated

Overview

This node operation retrieves data rows from a specified task in Octoparse starting from a given offset position. It is useful for paginating through large datasets extracted by Octoparse tasks, allowing users to fetch data in manageable chunks. For example, a user can fetch 100 rows starting from row 0, then fetch the next 100 rows starting from row 100, and so on.

Use Case Examples

  1. Fetch 100 rows of data starting from offset 0 for a specific task in a task group.
  2. Retrieve data in batches by specifying different offset values to paginate through the dataset.

Properties

Name Meaning
Task Group Select the task group to find the task in.
Task Select the specific task from which to retrieve data.
Offset Starting position of data retrieval, indicating from which row to begin fetching data.
Size Number of rows to retrieve, with a range from 1 to 1000.

Output

JSON

  • data - The retrieved data rows from the specified task starting at the given offset.

Dependencies

  • Octoparse API key credential for authentication.

Troubleshooting

  • Common issues include invalid task group or task IDs, which result in empty or error responses. Verify that the selected task group and task exist and are accessible.
  • Offset and size parameters must be within valid ranges; offset must be zero or positive, and size must be between 1 and 1000.
  • API rate limits or authentication errors may occur if the API key is invalid or expired. Ensure the API key credential is correctly configured and valid.

Discussion