Apify icon

Apify

Access Apify tools for web scraping, data extraction, and automation.

Dataset → Get Items

AI-generated

Overview

This node interacts with the Apify platform to retrieve items from a specified dataset. It is useful for scenarios where users need to access and process data collected or stored in Apify datasets, such as web scraping results or automation outputs. For example, a user can fetch a subset of records from a dataset for further analysis or integration with other workflows.

Use Case Examples

  1. Fetching the first 100 items from a dataset containing scraped product information.
  2. Retrieving specific fields from a dataset to minimize data transfer and processing.
  3. Skipping a number of items to paginate through large datasets.

Properties

Name Meaning
Dataset ID The identifier of the dataset to retrieve items from, which can be a dataset ID or a combination of username and dataset name.
Offset The number of items to skip at the start of the dataset, useful for pagination.
Limit The maximum number of items to return in the response, controlling the batch size.
Fields Comma-separated list of specific fields to include in the results, allowing selective data retrieval.
Omit Comma-separated list of fields to exclude from the results, which takes precedence over the fields included.
Authentication The method of authentication to use when connecting to Apify, either via API Key or OAuth2.

Output

JSON

  • items - Array of dataset items retrieved from Apify.

Dependencies

  • Apify API key or OAuth2 credentials for authentication

Troubleshooting

  • Ensure the Dataset ID is correct and accessible with the provided authentication method.
  • Check that the offset and limit values are within valid ranges to avoid empty or incomplete results.
  • Verify that the fields and omit parameters are correctly formatted as comma-separated strings.
  • Authentication errors may occur if the API key or OAuth2 token is invalid or expired; re-authenticate if needed.

Links

Discussion