Actions16
- Marketplace Dataset Actions
- Web Scraper Actions
- Web Unlocker Actions
Web Scraper → Get Snapshots
AI-generatedOverview
This node interacts with the Bright Data platform to retrieve snapshots from a specified web scraping dataset. It allows users to filter snapshots based on status, date range, and supports pagination through skip and limit parameters. This is useful for scenarios where users want to monitor or analyze the results of web scraping jobs, such as tracking data collection progress or reviewing collected data snapshots.
Use Case Examples
- Retrieve all snapshots with status 'ready' from a specific dataset within a given date range.
- Fetch a limited number of snapshots while skipping a certain number to paginate through results.
Properties
| Name | Meaning |
|---|---|
| Dataset | Select the dataset from which to retrieve snapshots. This is a required field and supports searching through available datasets. |
| Status | Filter snapshots by their status, such as 'ready', 'building', 'failed', etc. |
| Skip | Number of snapshots to skip, useful for pagination. |
| Limit | Maximum number of snapshots to return. |
| From Date | Start date to filter snapshots (ISO 8601 format). Required. |
| To Date | End date to filter snapshots (ISO 8601 format). Required. |
| Request Options | Additional request options such as batching, SSL certificate validation, proxy settings, and timeout. |
Output
JSON
snapshots- An array of snapshot objects retrieved from the specified dataset, filtered by the provided criteria.
Dependencies
- Requires an API key credential for Bright Data to authenticate requests.
Troubleshooting
- Ensure the dataset ID is valid and accessible with the provided credentials.
- Check that the date range is correctly formatted in ISO 8601 and that 'from_date' is before 'to_date'.
- Verify network connectivity and proxy settings if used.
- If SSL issues occur, consider enabling the option to ignore SSL certificate validation.
- Adjust timeout settings if requests are timing out.