Sitemap Generator icon

Sitemap Generator

Crawl websites and generate XML sitemaps with image support, priority settings, and change frequency. By John Rippy.

Sitemap Generator

AI-generated

Summary

Crawls the configured start URL through the Apify sitemap-generator actor and returns the actor’s dataset items when the run succeeds. Set crawl limits and sitemap options, then choose the output format and wait timeout for each input item.

Inputs

  • Start URL (required) — Website URL to crawl.
  • Max Pages — Maximum pages to crawl; 0 means unlimited. Defaults to 1000.
  • Max Crawl Depth — Maximum link depth from the start URL; 0 limits crawling to the start page. Defaults to 10.
  • Include Images — Include image URLs in the sitemap. Defaults to true.
  • Include Videos — Include video URLs in the sitemap. Defaults to false.
  • Include Last Modified — Try to detect last-modified dates from HTTP headers or meta tags. Defaults to true.
  • Respect robots.txt — Follow robots.txt rules while crawling. Defaults to true.
  • Output Format — Choose XML sitemap, XML sitemap index, JSON, or plain-text URLs. Defaults to XML.
  • Default Change Frequency — Change-frequency value applied to all URLs. Defaults to weekly.
  • Default Priority — Priority value applied to all URLs; declared range is 0.0 to 1.0. Defaults to 0.5.
  • Demo Mode — Run with sample data instead of actual crawling. Defaults to false.
  • Timeout (seconds) — How long the node waits for the actor run to finish. Defaults to 300 seconds.

Output shape

One output item per input item when the actor run completes; successful items contain runId, status, urlCount, and sitemapData.

The node requires Apify API credentials. sitemapData contains the dataset response items and urlCount is their array length. If the run finishes with a status other than SUCCEEDED, the item contains runId, status, and a failure message instead. API or other caught errors are raised as a node operation error.

Links

Discussion