FirecrawlInstall

Summary

Scrape a specified URL using the Firecrawl API to retrieve content in various formats, optionally focusing on the main content and applying tag inclusion or exclusion filters; supports caching scraped results with optional Postgres-backed cache.

Inputs

• url (required) — The URL of the web page to scrape.
• formats — One or more formats to return from the scrape; options include Markdown, HTML, Raw HTML, Content, Links, Screenshot, Full Page Screenshot, Extract, and JSON. Defaults to ['markdown'].
• onlyMainContent — Whether to return only the main content of the page, excluding headers, navigation, footers, etc. Defaults to true.
• includeTags — Optional list of tags, classes, or ids to include in the final output, specified as multiple string values.
• excludeTags — Optional list of tags, classes, or ids to exclude from the page, specified as multiple string values.
• cache — Caching option to speed up scraping by first checking stored results; options are 'none' or 'postgres'. Defaults to 'postgres'.
• cacheTTL — Time-to-live in seconds for cached entries when using Postgres cache; a negative value disables TTL. Defaults to -1.

Output shape

a list of JSON objects, one per input item, each containing the scrape result in the requested formats

Uses Firecrawl API to scrape the URL, throwing an error if scraping fails. Supports caching with Postgres to avoid repeated API calls. When caching is enabled and a cached result exists, returns it instead of making a new API request.

Links

• n8n community nodes installation guide