BrightData icon

BrightData

Interact with Bright Data to scrape websites or use existing datasets from the marketplace to generate adapted snapshots

Actions16

Marketplace Dataset → List Datasets

AI-generated

Overview

This node interacts with the Bright Data API to list datasets available in the Bright Data Marketplace. It is useful for users who want to access and utilize pre-existing datasets for data analysis, research, or integration into other workflows. For example, a user might use this node to retrieve a list of datasets related to e-commerce product prices or social media trends.

Use Case Examples

  1. Listing all available datasets in the Bright Data Marketplace to select one for further processing or analysis.
  2. Fetching datasets metadata to display options in a user interface for dataset selection.

Properties

Name Meaning
Request Options Settings to control request behavior such as batching, SSL certificate validation, proxy usage, and request timeout.

Output

JSON

  • datasets - An array of dataset objects retrieved from the Bright Data Marketplace, each containing metadata about a dataset such as its ID, name, description, and other relevant details.

Dependencies

  • Bright Data API with an API key credential for authentication

Troubleshooting

  • Common issues include request timeouts, which can be resolved by increasing the timeout setting.
  • SSL certificate validation errors can occur if the server's SSL certificate is invalid or untrusted; enabling 'Ignore SSL Issues' can bypass this but reduces security.
  • Proxy configuration errors may arise if the proxy URL or credentials are incorrect; verify proxy settings carefully.

Links

Discussion