BrightData icon

BrightData

Interact with Bright Data to scrape websites or use existing datasets from the marketplace to generate adapted snapshots

Actions14

Marketplace Dataset → Get Snapshot Content

AI-generated

Overview

This node interacts with the Bright Data Marketplace Dataset resource to retrieve snapshot content. It allows users to fetch data snapshots from the Bright Data marketplace in various formats (JSON, JSONL, CSV) with options to compress the response, specify batch size, and select a specific part of the snapshot. This is useful for users who want to programmatically access large datasets in manageable chunks, for example, to analyze market trends or perform data-driven research.

Use Case Examples

  1. Fetching a specific snapshot's content in JSON format for data analysis.
  2. Downloading a compressed CSV batch of snapshot data for storage optimization.
  3. Retrieving a particular part of a large snapshot to process data incrementally.

Properties

Name Meaning
Snapshot ID The ID of the snapshot to operate on, required to identify which snapshot content to retrieve.
Compress Whether to compress the response in gzip format, useful for reducing data transfer size.
Batch Size Number of records to include in each response batch, allowing control over the size of data chunks retrieved.
Part Number of the batch to return, starting from 1, enabling pagination through snapshot data.
Format Format of the response data, allowing selection between JSON, JSONL, or CSV formats.

Output

JSON

  • items - The snapshot content data returned from the Bright Data API, structured according to the selected format and batch parameters.

Dependencies

  • Requires an API key credential for Bright Data API authentication.

Troubleshooting

  • Ensure the Snapshot ID is provided; missing this will cause an error.
  • Invalid JSON format in input parameters (if applicable) will cause parsing errors.
  • API request failures may occur due to network issues or invalid credentials; verify API key and network connectivity.

Links

Discussion