Actions2
- Scrape Actions
Batch
AI-generatedSummary
Submit multiple URLs as a batch job to scrape them in parallel with optional webhook notification and polling for completion.
Inputs
- URLs (JSON Array) (required) — An array of URL objects to scrape in parallel (maximum 100). Each URL object may include fields such as url, mode, formats, advanced options, and cost controls.
- Batch Options — Optional settings for the batch including webhookUrl to notify when all jobs complete, waitForCompletion boolean to decide whether to poll until completion, and pollTimeout in seconds specifying maximum polling duration.
Output shape
A single object representing the batch job status and results after submission and optional polling.
If waitForCompletion is true (default), this operation polls the batch job status until it completes or the pollTimeout (default 300 seconds) is reached before returning the final batch status. If waitForCompletion is false, the response after submission is returned immediately without polling. On completion, the output includes the batch status (completed or failed), batch ID, and details of each job's scraping result.
Examples
Example 1: Submit 3 URLs for parallel scraping and wait for all to complete
Set URLs as a JSON array of objects with URLs and optional modes/formats. Leave default batch options with waitForCompletion true. The node returns detailed results once all jobs finish.