Crawleo icon

Crawleo

Crawleo Search and Crawler API

Actions5

Crawler → Crawler

AI-generated

Summary

Crawl one or more specified URLs using Crawleo's standard crawler with options for JavaScript rendering, geolocation, and output format including raw HTML, enhanced HTML, text, markdown, and screenshots.

Inputs

  • URLs (required) — One or more URLs to crawl, specified as multiple inputs or a comma-separated list.
  • Options — Collection of optional parameters including Render JavaScript (enabling browser rendering for JavaScript-heavy sites), Geolocation (ISO 3166-1 alpha-2 country code for crawl location), Raw HTML (return page source as-is), Enhanced HTML (return cleaned/sanitized HTML, default true), Page Text (return plain-text extraction of page content), Markdown (return markdown conversion, default true), Screenshot (capture screenshot, requires Render JavaScript enabled), and Full Page Screenshot (capture full-page screenshot, requires Screenshot enabled).

Output shape

An array of JSON objects representing the crawl results for each URL.

Results include the requested output formats as per options. Each URL's response is returned as a separate item in the output array. If multiple URLs are provided, all are crawled and their results returned together.

Links

Discussion