Anakin icon

Anakin

Scrape websites, search with AI, and extract structured data

Actions108

Monitor → Scrape URL

AI-generated

Summary

Scrape the content of a specified website URL by submitting a scraping job to the Anakin API and polling until the job completes or fails, returning the scraped data and job details.

Inputs

  • URL (required) — The URL of the website to scrape.
  • Additional Options — Optional parameters including Max Wait Time (seconds) to wait for job completion (default 300), Poll Interval (seconds) for status checks (default 3), Country Code for proxy routing (default 'us'), and Force Fresh to bypass cache and force a fresh scrape (default false).

Output shape

a single JSON object containing the scraping job status, details, and the extracted content if the job completes successfully

The operation submits a job and polls asynchronously until completion or failure, or until the max wait time is exceeded. On success, returns the job result JSON including jobId, status, and scraped data; on failure or timeout, throws an error. Results are paired to the input item.

Examples

Example 1: Scrape a URL with default options

Set 'URL' to 'https://example.com' and leave Additional Options as defaults; node returns scraped content on completion.

Links

Discussion