Simplescraper icon

Simplescraper

Scrape web pages, run saved recipes, and extract structured data via Simplescraper

Page → AI Extract

AI-generated

Summary

Extracts structured data from a web page using AI by POSTing the URL and a comma-separated list of desired properties to Simplescraper's /smart-extract endpoint. No saved recipe is required.

Inputs

  • url (required) — The page URL to extract structured data from (sent as url in the request body).
  • schema (required) — Comma-separated list of properties to extract, e.g. "name, price, availability, sku, brand" (sent as schema in the body).
  • requestOptions — Optional node settings for the HTTP request: batching (items per batch, default 50, and interval between batches, default 1000 ms), ignore SSL certificate issues, proxy URL, and timeout in ms (default 10000).

Output shape

The raw JSON response from Simplescraper's /smart-extract endpoint, returned as the node's output item(s). No post-processing or row splitting is applied.

The exact response fields aren't defined in the node source, so they depend on the API. Requires Simplescraper API credentials. The default 10 s timeout may be short for AI extraction on slow pages, so consider raising it.

Examples

Example 1: Pull product details from an e-commerce product page

URL = https://example.com/product/123; Schema = "name, price, availability, sku, brand"

Example 2: Extract article metadata for each URL coming from a previous node

URL = {{ $json.link }}; Schema = "title, author, publish date, summary"; Request Options > Timeout = 30000

Links

Discussion