BrightData icon

BrightData

Interact with Bright Data to scrape websites or use existing datasets from the marketplace to generate adapted snapshots

Marketplace Dataset → Get Dataset Metadata

AI-generated

Overview

This node interacts with the Bright Data API to retrieve metadata for a specific dataset from the Marketplace Dataset resource. It is useful for users who want to access detailed information about datasets available in the Bright Data marketplace, such as dataset properties and descriptions, to better understand the data they plan to use or analyze.

Use Case Examples

  1. A user selects a dataset from a searchable list and retrieves its metadata to review dataset details before using it in a data processing workflow.
  2. A workflow automatically fetches metadata for multiple datasets to generate a report or to validate dataset attributes before further processing.

Properties

Name Meaning
Dataset The specific dataset to retrieve metadata for, selected from a searchable list of available datasets in the Bright Data marketplace.
Request Options Additional options to customize the API request, including batching parameters, SSL certificate validation behavior, proxy settings, and request timeout.

Output

JSON

  • datasetMetadata - The metadata information of the selected dataset retrieved from the Bright Data API.

Dependencies

  • Bright Data API key credential

Troubleshooting

  • Ensure the Bright Data API credentials are correctly configured and valid to avoid authentication errors.
  • If SSL certificate validation errors occur, consider enabling the 'Ignore SSL Issues' option to bypass certificate checks, but be aware of security risks.
  • Check proxy settings if requests fail due to network restrictions or firewall rules.
  • Adjust the timeout setting if the API response is slow or times out frequently.

Links

Discussion