Crawlora icon

Crawlora

Get structured web data from the public web via the Crawlora API

Actions166

Web → Web Scrape

AI-generated

Summary

Scrape a URL through the Crawlora API and request structured web data in the selected formats. Configure the required API key and URL; optional settings control rendering, caching, content selection, proxy use, and wait time.

Inputs

  • X Api Key (required) — Crawlora API key sent in the x-api-key request header.
  • Url (required) — URL to scrape. Defaults to https://example.com.
  • Backend — Optional backend value sent in the request body.
  • Formats — JSON array of output formats; defaults to ["markdown"].
  • Max Age — Maximum age in milliseconds for cached data; defaults to 604800000.
  • Only Main Content — Whether to return only the main page content; defaults to true.
  • Proxy — Optional proxy value sent in the request body.
  • Render — Rendering mode: Auto, Http, Browser, or Unblocker. Defaults to Auto.
  • Store In Cache — Whether to store the result in cache; defaults to true.
  • Wait For — Wait time in milliseconds; defaults to 0.
  • Request Options — HTTP request settings, including batching, SSL certificate validation, an HTTP proxy, and timeout.

Output shape

A list of n8n items containing the API response.

The source pack defines the API base URL and request defaults but does not include operation execution code, so the exact response fields and item mapping are not shown.

Examples

Example 1: Scrape a page as Markdown

Provide the Crawlora API key and target URL; leave Formats at its default of ["markdown"].

Example 2: Use browser rendering and wait for page content

Set Render to Browser and configure Wait For in milliseconds.

Links

Discussion