Anakin icon

Anakin

Scrape websites, search with AI, and extract structured data

Actions108

AI Visibility → Scrape URL

AI-generated

Summary

Submit a scraping job to fetch and extract content from a specified website URL, then poll the job status until completion or failure within a configurable timeout period.

Inputs

  • URL (required) — The URL of the website to scrape.
  • Additional Options — Optional settings including Max Wait Time (seconds) to wait for job completion (default: 300), Poll Interval (seconds) between status checks (default: 3), Country Code for proxy routing (default: "us"), and Force Fresh boolean to bypass cache and force a fresh scrape (default: false).

Output shape

A single JSON object containing the scraping job's final result upon success or an error indication in case of failure.

The operation submits the scrape request then polls status until completion, error, or timeout. On success, returns detailed scrape result JSON including success flag, operation name, request ID, and scraped data. Errors or timeouts throw exceptions unless Continue On Fail is enabled, in which case an error object is returned. Poll timing and timeout can be customized via Additional Options.

Examples

Example 1: Scrape example.com homepage with default options

Provide the required URL parameter as https://example.com; leave additional options empty or at defaults.

Links

Discussion