Spider icon

Spider

Crawl and scrape websites using the Spider API

Links

AI-generated

Summary

Extract all links from the specified webpage URL, optionally following links to a specified depth.

Inputs

  • URL (required) — The URL of the webpage from which to extract links.
  • Output Mode — Determines how to return multi-page link extraction results: either as separate items per page or combined into a single item array.
  • Additional Fields — Optional settings including Anti-Bot Protection, Crawl Depth to follow links recursively, proxy usage, headless browser rendering, metadata inclusion, and readability mode.

Output shape

A list of JSON items each containing extracted link data (one item per page) or a single JSON item with an array of results depending on Output Mode.

The output shape depends on the Output Mode: 'One Item per Page' returns multiple n8n items each corresponding to one page's links; 'All Pages in One Item' returns a single item with all link results as an array. The depth parameter controls link-following recursion.

Links

Discussion