BrightData icon

BrightData

Interact with Bright Data to scrape websites or use existing datasets from the marketplace to generate adapted snapshots

Marketplace Dataset → Get Snapshot Metadata

AI-generated

Overview

This node interacts with the Bright Data platform to retrieve metadata about a specific snapshot from the Marketplace Dataset resource. It is useful for users who need detailed information about a snapshot, such as its properties and status, without downloading the entire snapshot content. For example, it can be used to check snapshot details before deciding to process or analyze the data further.

Use Case Examples

  1. Retrieve metadata for a snapshot by providing its Snapshot ID to understand its contents and status before processing.
  2. Use the snapshot metadata to monitor data freshness or validate snapshot properties in an automated workflow.

Properties

Name Meaning
Snapshot ID The unique identifier of the snapshot to retrieve metadata for. This is a required input to specify which snapshot's metadata to fetch.

Output

JSON

  • id - The unique identifier of the snapshot.
  • status - The current status of the snapshot (e.g., completed, processing).
  • created_at - Timestamp when the snapshot was created.
  • updated_at - Timestamp when the snapshot metadata was last updated.
  • size - The size of the snapshot data.
  • records_count - Number of records contained in the snapshot.
  • additional_metadata - Any other metadata fields returned by the Bright Data API about the snapshot.

Dependencies

  • Requires an API key credential for Bright Data platform authentication to make authorized requests.

Troubleshooting

  • Common issues include missing or invalid Snapshot ID, which will cause the node to throw an error indicating the Snapshot ID is required.
  • API request failures due to network issues or invalid credentials will result in errors; ensure the Bright Data API key is valid and network connectivity is stable.
  • Invalid or expired Snapshot ID may cause the API to return errors; verify the Snapshot ID is correct and the snapshot exists.

Links

Discussion