crawlora-web

n8n community node for the Crawlora Web Scraper — turn any URL into clean Markdown, HTML, links, or metadata. Single-service, AI-agent ready.

Package Information

Released: 4 mo ago
Downloads: 14 weekly / 163 monthly
Latest Version: 0.1.0
Author: Crawlora

Documentation

n8n-nodes-crawlora-web

An n8n community node for the Crawlora Web Scraper. Turn any URL
into clean, LLM-ready Markdown, HTML, links, or metadata in one step —
with managed proxies, headless-browser rendering, and anti-bot handling behind a single
API call. Works as a regular node and as an AI Agent tool.

Crawlora is an agent-native web scraping and structured-data API.
This package is the focused, single-service web scraping node; for the full catalog of
300+ structured endpoints (search, marketplaces, social, maps, app stores, finance, and
more) see the Crawlora MCP server.

Installation

Follow the community node installation guide.

In your n8n instance, go to Settings → Community Nodes → Install and enter:

n8n-nodes-crawlora-web

Or install from the command line in your n8n root folder:

npm install n8n-nodes-crawlora-web

Credentials

You need a Crawlora API key. Create one in the Crawlora dashboard.

In n8n, add a Crawlora API credential and paste your key. The key is sent as the
x-api-key header on every request.

Operations

Web Scraping → Scrape

Scrape a single URL into the formats you choose.

Field Description
URL The page to scrape, e.g. https://example.com.
Formats One or more of markdown (default), html, raw_html, links, metadata.
Only Main Content Strip navigation, headers, footers, and other boilerplate (default true).
Render Mode auto (default — escalate from HTTP to a headless browser only when needed), http, browser, or unblocker.
Wait For (ms) Extra time to wait after load when rendering in a browser.
Max Age (ms) Return a cached page if it is newer than this many milliseconds — saves credits and time. 0 always fetches fresh.
Store in Cache Cache this scrape for later Max Age reuse (default true).

Example output (formats: ["markdown", "links", "metadata"]):

{
  "markdown": "# Example Domain\n\nThis domain is for use in illustrative examples…",
  "links": ["https://www.iana.org/domains/example"],
  "metadata": {
    "title": "Example Domain",
    "language": "en",
    "status_code": 200,
    "source_url": "https://example.com",
    "content_type": "text/html; charset=UTF-8"
  },
  "scrape": { "method": "http", "escalated": false }
}

Use as an AI Agent tool

This node has usableAsTool enabled, so an n8n AI Agent can call it directly — for
example, "read this URL and summarize it" or "extract the links from this page" — without a
custom HTTP node.

Compatibility

  • Requires n8n with n8nNodesApiVersion: 1 (n8n 1.x).
  • Node.js >=20.15.

Resources

License

MIT

Discussion