Actions108
- AI Visibility Actions
- List Sources
- Search
- Agentic Search
- AI Visibility Search
- AI Visibility Sources
- Browser Task
- Control Monitor
- Crawl
- Create Monitor
- Delete Session
- Get Monitor Changes
- List Monitors
- List Sessions
- Map
- Scrape URL
- Wire: Browse Catalog
- Wire: Discover Actions
- Wire: List Identities
- Wire: Request New Action
- Wire: Run Read Action
- Wire: Run Write Action
- Wire: Sign In
- Browser Actions
- Delete Session
- List Sessions
- Run Task
- Agentic Search
- AI Visibility Search
- AI Visibility Sources
- Browser Task
- Control Monitor
- Crawl
- Create Monitor
- Get Monitor Changes
- List Monitors
- Map
- Scrape URL
- Search
- Wire: Browse Catalog
- Wire: Discover Actions
- Wire: List Identities
- Wire: Request New Action
- Wire: Run Read Action
- Wire: Run Write Action
- Wire: Sign In
- Monitor Actions
- Control
- Create
- Get Changes
- List
- Agentic Search
- AI Visibility Search
- AI Visibility Sources
- Browser Task
- Control Monitor
- Crawl
- Create Monitor
- Delete Session
- Get Monitor Changes
- List Monitors
- List Sessions
- Map
- Scrape URL
- Search
- Wire: Browse Catalog
- Wire: Discover Actions
- Wire: List Identities
- Wire: Request New Action
- Wire: Run Read Action
- Wire: Run Write Action
- Wire: Sign In
- Web Actions
- Agentic Search
- Crawl
- Map
- Scrape URL
- Search
- AI Visibility Search
- AI Visibility Sources
- Browser Task
- Control Monitor
- Create Monitor
- Delete Session
- Get Monitor Changes
- List Monitors
- List Sessions
- Wire: Browse Catalog
- Wire: Discover Actions
- Wire: List Identities
- Wire: Request New Action
- Wire: Run Read Action
- Wire: Run Write Action
- Wire: Sign In
- Wire Actions
Web → Scrape URL
AI-generatedSummary
Scrape a website URL to extract its content by submitting a scraping job and polling until completion or failure.
Inputs
- URL (required) — The URL of the website to scrape.
- Additional Options — Optional parameters including Max Wait Time (seconds) to wait for scraping completion (default 300), Poll Interval (seconds) between status checks (default 3), Country Code for proxy routing (default 'us'), and Force Fresh to bypass cache and force a fresh scrape (default false).
Output shape
A JSON object with success status, operation name, request ID, scraped URL, and detailed scraping job results.
The operation asynchronously submits a scraping job to the API and polls for its status until the job completes successfully, fails, or times out based on the Max Wait Time parameter. On success, detailed scraped content and metadata are returned. If the job fails or times out, an error is thrown unless continueOnFail() is enabled, in which case an error object is returned per item.
Examples
Example 1: Basic usage
Set 'URL' to the website you want to scrape. Optionally adjust Max Wait Time or Poll Interval in Additional Options to control how long to wait and how frequently to check job status.