Scrapfly icon

Scrapfly

Scrapfly data collection APIs for web page scraping, screenshots, and AI data extraction

Actions5

Scrape → Scrape API Request

AI-generated

Summary

Sends a Scrapfly scrape API request for the required URL using the selected HTTP method. Optional body, headers, proxy pool, country, unblocker, session, sticky proxy, and debug settings are added to the request; the operation returns Scrapfly’s response data.

Inputs

  • URL (required) — Web page URL to scrape.
  • Method (required) — HTTP method: GET, HEAD, OPTIONS, PATCH, POST, or PUT; defaults to GET.
  • Additional Fields → Body — HTTP request body. For POST, PUT, or PATCH, the implementation sends it as the request body.
  • Additional Fields → Headers — HTTP headers as key/value pairs.
  • Additional Fields → Proxy Pool — Proxy IP pool: public datacenter or public residential; defaults to public datacenter.
  • Additional Fields → Country — Proxy geolocation country code; defaults to us.
  • Additional Fields → Unblocker — Enable Scrapfly Unblocker to help bypass anti-bot protection; defaults to false.
  • Additional Fields → Session — Session name for reusing cookies, fingerprint, and proxy across scrapes. The UI describes it as alphanumeric and at most 255 characters.
  • Additional Fields → Session Sticky Proxy — Request best-effort reuse of the same proxy IP; defaults to true.
  • Additional Fields → Debug — Enable debug mode; defaults to false.

Output shape

A Scrapfly response object, wrapped as n8n JSON output for the input item.

The node processes each input item and associates the result with that item. If Continue On Fail is enabled, errors are returned as an object with an error field. The listed inputs are encoded as scrape query parameters except the body, which is sent in the request body for POST, PUT, and PATCH.

Links

Discussion