Actions16
- Marketplace Dataset Actions
- Web Scraper Actions
- Web Unlocker Actions
Marketplace Dataset → Get Snapshot Content
AI-generatedOverview
This node interacts with the Bright Data Marketplace Dataset resource to retrieve the content of a specific snapshot. It allows users to fetch data in batches from a snapshot, specifying the format and compression options. This is useful for processing large datasets in manageable parts, such as downloading a portion of a dataset for analysis or integration into other workflows.
Use Case Examples
- Fetching the first batch of a snapshot's content in JSON format for data analysis.
- Retrieving a compressed CSV batch from a snapshot to save bandwidth and storage.
- Iterating through multiple parts of a snapshot to process large datasets incrementally.
Properties
| Name | Meaning |
|---|---|
| Snapshot ID | The ID of the snapshot to operate on, required to identify which snapshot's content to retrieve. |
| Compress | Whether to compress the response in gzip format to reduce data size during transfer. |
| Batch Size | Number of records to include in each response batch, controlling the size of data chunks returned. |
| Part | Number of the batch to return, starting from 1, to paginate through the snapshot content. |
| Format | Format of the response data, allowing selection between JSON, JSONL, or CSV formats. |
Output
JSON
snapshotContent- The content of the snapshot batch retrieved, formatted as specified (JSON, JSONL, or CSV).
Dependencies
- Requires an API key credential for Bright Data API authentication.
Troubleshooting
- Ensure the Snapshot ID is valid and exists in the Bright Data Marketplace to avoid errors.
- Check network connectivity and API endpoint accessibility if requests time out or fail.
- Verify that the batch size and part number are within valid ranges to prevent empty or invalid responses.
- If using compression, ensure the client can handle gzip compressed responses to avoid data corruption.
Links
- Bright Data API Documentation - Get Snapshot Content - Official API documentation for retrieving snapshot content from the Bright Data Marketplace Dataset.