Simplescraper icon

Simplescraper

Scrape web pages, run saved recipes, and extract structured data via Simplescraper

Actions8

URL → Extract URLs

AI-generated

Summary

Discovers all URLs on a website via its sitemap using Simplescraper's /extract-urls endpoint, returning one n8n item per URL. No credits are consumed.

Inputs

  • Website URL (required) — Full URL including protocol (e.g. https://example.com) of the site to extract URLs from. Sent as domain in the request body.
  • URL Limit — Maximum number of URLs to return. 0 (default) means no limit and the field is omitted from the request.
  • Sitemap Limit — For sitemap-index sites, maximum number of nested sitemaps to traverse. 0 (default) means no limit and the field is omitted.
  • Request Options — Optional node settings: batching (items per batch, interval in ms), ignore SSL issues, HTTP proxy, and timeout in ms (default 10000).

Output shape

A list of items, one per discovered URL, each shaped as { url: "" }.

Items are taken from the response's data.urls array. If that array is missing or empty, the operation returns no items. Requires Simplescraper API credentials. A large site with no limits can produce many items.

Examples

Example 1: List every page on a site to feed a later scraping step

Website URL = https://example.com, URL Limit = 0, Sitemap Limit = 0

Example 2: Sample a small number of URLs from a large sitemap-index site

Website URL = https://example.com, URL Limit = 100, Sitemap Limit = 2

Links

Discussion