Actions16
- Marketplace Dataset Actions
- Web Scraper Actions
- Web Unlocker Actions
Web Scraper → Monitor Progress Snapshot
AI-generatedOverview
This node interacts with the Bright Data service to monitor the progress of a web scraping snapshot. It is useful for users who want to track the status and progress of their web scraping tasks managed through Bright Data. For example, a user can input a snapshot ID to retrieve the current progress of that specific scraping job.
Use Case Examples
- Monitoring the progress of a web scraping snapshot by providing its snapshot ID to check if the scraping task is completed or still running.
- Using the node to automate the tracking of multiple snapshots' progress in a web scraping workflow.
Properties
| Name | Meaning |
|---|---|
| Snapshot ID | The ID of the snapshot to operate on, used to specify which snapshot's progress to monitor. |
| Request Options | Additional options to customize the request such as batching, SSL certificate validation, proxy settings, and timeout duration. |
Output
JSON
snapshotStatus- The current status of the snapshot being monitored, such as running, completed, or failed.progressDetails- Detailed information about the progress of the snapshot, including metrics like percentage completed or items processed.
Dependencies
- Requires an API key credential for Bright Data to authenticate requests.
Troubleshooting
- Common issues include invalid or missing snapshot ID, which will cause the node to fail to retrieve progress information.
- SSL certificate validation errors if the 'Ignore SSL Issues' option is not enabled and the server's certificate is invalid.
- Timeout errors if the server does not respond within the specified timeout period; increasing the timeout may help.
- Proxy configuration errors if the proxy URL or credentials are incorrect.
Links
- Bright Data API Documentation - Monitor Progress Snapshot - Official documentation for the Bright Data API endpoint to monitor the progress of a web scraping snapshot.