Crawl4aiInstall

Summary

Process multiple URLs concurrently using customized browser and anti-detection settings with optional authentication and advanced configuration options.

Inputs

• URL Configuration (required) — One or more URLs to crawl, each specified as a string.
• Browser Configuration — Settings for the browsing context including headless mode, viewport dimensions, and user agent string.
• Anti-Detection Settings — Options to enable undetected or stealth browser modes and configure CAPTCHA bypass strategies.
• Authentication Configuration — Enable and configure authentication types such as Basic Auth, Form Auth, OAuth2, API Key, or Session Cookie with appropriate credentials and optionally a login URL.
• Advanced Configuration — Advanced crawl options including max retries, request timeout, concurrent requests, proxy usage with proxy URL, and debug logging.

Output shape

a list of JSON objects, each representing the processing result of one input URL.

Each output item includes success status, the operation type, full configuration applied for that URL including browser, anti-detection, authentication, and advanced settings, along with a timestamp. On failure, the output includes an error message and a success flag set to false. Output items are paired with their corresponding input items.