Crawleo icon

Crawleo

Crawleo Search and Crawler API

Crawler → Headful Browser

AI-generated

Summary

Crawl one or more URLs using Crawleo's premium headful browser with residential proxies and advanced anti-bot evasion, retrieving rendered page content in various formats and optionally capturing a full-page screenshot.

Inputs

  • URLs (required) — One or more URLs to crawl with the headful browser; enter each URL as a separate string.
  • Options — Optional settings controlling the crawl such as country code for proxy geolocation, output format for the page content, and whether to capture a screenshot.

Output shape

a list of items representing the crawled page data for each URL requested, including the page content in the requested format and, if enabled, a screenshot URL.

The output format can be Markdown, Enhanced HTML, Raw HTML, or plain Page Text depending on the 'Output Format' option. If 'Screenshot' is enabled, the response will include a URL to the captured full-page screenshot. This operation communicates with the '/headful-browser' endpoint via a GET request, passing URLs and options as query parameters.

Examples

Example 1: Crawl multiple URLs with rendered JavaScript and get Markdown output

Set multiple URLs in the 'URLs' field, choose 'Markdown' for 'Output Format', optionally specify 'Country' for proxy location, and leave 'Screenshot' disabled if no screenshot is needed.

Example 2: Crawl a single URL with a full-page screenshot

Enter one URL, set 'Screenshot' to true in the options, pick an 'Output Format' such as 'Enhanced HTML', and optionally specify the proxy country code.

Links

Discussion