BrightData icon

BrightData

Interact with Bright Data to scrape websites or use existing datasets from the marketplace to generate adapted snapshots

Actions14

Marketplace Dataset → List Snapshots

AI-generated

Overview

This node interacts with the Bright Data Marketplace Dataset resource to list snapshots of a specified dataset. It allows users to filter snapshots by dataset ID, view ID, and snapshot status. This operation is useful for retrieving metadata about dataset snapshots, monitoring their status, or managing data versions in data scraping and data marketplace scenarios.

Use Case Examples

  1. A user wants to retrieve all snapshots of a particular dataset that are in 'ready' status to process the latest available data.
  2. A user filters snapshots by a specific view ID to analyze data from a particular perspective or subset.
  3. A user monitors snapshots with different statuses to track the progress of data collection and processing.

Properties

Name Meaning
Dataset The ID of the dataset for which to list snapshots. This is a required property and is selected from a searchable list of datasets.
View Optional ID of the view to filter the snapshots. Allows narrowing down snapshots to a specific view within the dataset.
Status The status of the snapshots to filter by, such as 'ready', 'building', 'failed', etc. Defaults to 'ready'.

Output

JSON

  • dataset_id - The ID of the dataset for which snapshots are listed.
  • view_id - The ID of the view used to filter snapshots, if provided.
  • status - The status filter applied to the snapshots.
  • snapshots - An array or list of snapshot objects returned by the API, each representing a snapshot of the dataset with its metadata and status.

Dependencies

  • Requires an API key credential for Bright Data API authentication.

Troubleshooting

  • Common issues include missing or invalid dataset ID, which will cause the node to throw an error indicating the dataset ID is required.
  • Invalid or expired API credentials can cause authentication errors when calling the Bright Data API.
  • Incorrect JSON format in input parameters (not applicable directly for this operation but relevant for other operations) can cause parsing errors.
  • Network or API service issues can cause request failures; retrying or checking API status is recommended.

Links

Discussion