Actions15
Submit Crawl Job
AI-generatedSummary
Submits the supplied URLs as an asynchronous Crawl4AI crawl job, with optional browser, crawl, and completion webhook settings. Returns the job identifier so the workflow can check its status later.
Inputs
- URLs (required) — URLs to crawl, entered one per line.
- Browser & Session — Optional browser configuration, including browser profile and engine, headers, cookies, JavaScript, proxy, session and storage state, timeout, and viewport.
- Crawl Settings — Optional crawl behavior such as cache mode, robots.txt checking, content selector and exclusions, JavaScript to run, wait conditions, retries, and anti-bot settings.
- Webhook Config — Optionally provide a URL to POST results to when the job completes, with custom headers and a setting controlling whether result data is included in the payload.
Output shape
A single job-submission record containing the task identifier.
The crawl runs asynchronously; use the job status operation to retrieve its status and, when available, results.