Crawl4aiInstall

Summary

Extract structured data from web pages using CSS selectors by crawling specified URLs with configurable browser, anti-detection, authentication, and advanced settings.

Inputs

• URL Configuration (required) — Provide one or more URLs to crawl and extract data from.
• Browser Configuration — Customize browser options such as headless mode, viewport size, and user agent for the crawling session.
• Anti-Detection Settings — Configure detection prevention options including undetected mode, stealth mode, and CAPTCHA bypass strategies.
• Authentication Configuration — Set authentication parameters if the target pages require login, supporting multiple authentication types like Basic, Form, OAuth2, API key, or session cookie.
• Advanced Configuration — Adjust advanced options like max retries, timeout, concurrency, proxy usage, and debug mode.

Output shape

a list of JSON objects corresponding to each URL processed

Each output object contains structured extraction results or error details with success status and timestamp. Outputs align one-to-one with input items, providing detailed crawl configuration and status per URL.