Anakin icon

Anakin

Scrape websites, search with AI, and extract structured data

Actions108

Browser → Map

AI-generated

Summary

Map website URLs by starting from a specified URL and discovering all reachable URLs under the site, effectively revealing the site structure within defined constraints.

Inputs

  • URL (required) — The starting URL for link discovery, typically a homepage or section root.
  • Additional Options — Optional parameters to control link discovery including depth of link-hops to follow (default 2), whether to include external links or subdomains, maximum number of URLs to return, limits per depth level for breadth control, max wait time for job completion, poll interval between status checks, optional keyword filter to restrict URLs by path/title, and whether to use a headless browser for rendering single-page applications.

Output shape

a single record

Returns an object containing the job status, discovered URLs, and details like job ID and input URL after completion. The operation waits asynchronously for the mapping job to complete, polling the API until success, failure, or timeout.

Examples

Example 1: Discover all URLs within a website starting from its homepage with default depth and limits.

Specify the starting URL; other options use their defaults. The node submits the map job and waits for the map results to return URLs discovered within two link-hops, limited to 50 results by default.

Links

Discussion