AnySite Web Parser (beta) icon

AnySite Web Parser (beta)

Parse and crawl websites using AnySite API

Map

AI-generated

Summary

Discover URLs from a starting point via the AnySite API

Inputs

  • url (required) — Starting URL for URL discovery
  • search — Optional search term to filter URLs
  • ignoreSitemap — Skip sitemap.xml discovery and only use HTML links
  • sitemapOnly — Only use sitemap.xml for discovery, ignore HTML links
  • includeSubdomains — Include URLs from subdomains in results
  • limit — Max number of results to return
  • baseUrl — Custom API base URL (leave empty to use default)

Output shape

json

Each item contains the AnySite API response. Array responses emit each element as a separate item; non-array responses emit as a single item.

Examples

Example 1: Map operation with minimal parameters

url provided, all other parameters left at defaults. The node POSTs to /map and returns discovered URL data.

Discussion