ScrapingBeeInstall

Summary

Scrape a webpage using the ScrapingBee HTML API by providing the target URL and optional settings to customize the request.

Inputs

• URL (required) — The target webpage URL to scrape.
• Forward Headers — Whether to forward particular headers and ScrapingBee-generated headers to the target webpage.
• Specify Headers As — Format to specify forwarded headers: key/value pairs or raw JSON.
• Headers (JSON) — Raw JSON object of headers to forward; keys must be prefixed with "Spb-".
• Headers (Key/Value) — List of key/value headers to forward; keys are prefixed with "Spb-" automatically.
• Additional Fields — Optional parameters to customize scraping such as AI extraction rules, blocking ads or resources, cookies, device type, JavaScript rendering options, proxy settings, screenshots, timeout, and more.

Output shape

a list of items each containing the scraped response as JSON or text, or binary data if the content is a file.

The output includes the full HTTP response content handled based on content-type: parsed JSON, plain text, or binary data (e.g., images or files). Options control returned content like raw HTML, text only, markdown, screenshots, and more. Errors appear in output JSON if continue on fail is enabled.

Examples

Example 1: Scrape the HTML content of a web page by specifying the URL and configure optional parameters to block ads and resources, set device type, or receive output as JSON.

URL input with optional additional fields for ad/resource blocking and device control. Output returns scraped page content.

Example 2: Send custom headers to the target webpage during scraping by enabling Forward Headers and specifying them as key/value pairs or JSON.

Enable Forward Headers with header details to send custom headers prefixed automatically or manually.

Links

• n8n community nodes installation guide