BrightData icon

BrightData

Interact with Bright Data to scrape websites or use existing datasets from the marketplace to generate adapted snapshots

Marketplace Dataset → Get Dataset Metadata

AI-generated

Overview

This node interacts with the Bright Data Marketplace Dataset resource to retrieve metadata about datasets. It is useful for users who want to access detailed information about specific datasets available in the Bright Data marketplace, such as dataset descriptions, schema, and other metadata. For example, a user can select a dataset from a list and fetch its metadata to understand the dataset's contents before using it in further data processing or analysis workflows.

Use Case Examples

  1. Fetch metadata for a selected dataset to review its schema and details before processing.
  2. Retrieve dataset metadata to validate dataset contents in an automated data pipeline.

Properties

Name Meaning
Dataset The specific dataset selected from the Bright Data marketplace for which metadata will be retrieved.

Output

JSON

  • id - The unique identifier of the dataset.
  • name - The name of the dataset.
  • description - A description of the dataset.
  • schema - The schema or structure of the dataset.
  • created_at - The creation date of the dataset.
  • updated_at - The last update date of the dataset.

Dependencies

  • Requires an API key credential for Bright Data API authentication.

Troubleshooting

  • Common issues include missing or invalid dataset ID, which results in errors indicating 'Dataset ID is required'.
  • API request failures due to network issues or invalid credentials will throw errors that should be handled by verifying API key and network connectivity.
  • Invalid JSON input for filters or URLs in other operations can cause parsing errors; ensure JSON inputs are correctly formatted.

Links

Discussion