Simplescraper icon

Simplescraper

Scrape web pages, run saved recipes, and extract structured data via Simplescraper

Actions8

Recipe → Run

AI-generated

Summary

Runs a saved Simplescraper recipe via POST /recipes/{recipeId}/run, optionally overriding the target URL or scraping many URLs, and returns the API response. Defaults to asynchronous mode, which returns a results_id to fetch later.

Inputs

  • Recipe (required) — The saved recipe to run, chosen from a searchable list of your recipes or entered by ID.
  • Source URL — Overrides the recipe's saved URL for this run. Leave blank to use the saved URL; blank values are not sent.
  • URLs — Multiple URLs to scrape through the recipe in one run (up to 5000, limited by available credits). Replaces the recipe's saved crawler list and always runs asynchronously, returning a results_id.
  • Run Asynchronously — Defaults to true. Returns immediately with a results_id to poll later; recommended for recipes taking over 30 seconds. Set to false to wait for the scrape.
  • Extract Markdown — Defaults to false. When enabled, the response includes a Markdown version of the page.
  • Request Options — Node settings for batching (items per batch, interval), ignoring SSL issues, proxy, and request timeout (default 10000 ms).

Output shape

The raw JSON body returned by the Simplescraper API for the run. For async runs this includes a results_id. For synchronous runs it contains the scraped data.

Unlike Get Latest Results and Get Results by ID, Run has no postReceive step, so scraped rows are not split into separate items. Use Get Results by ID with the results_id to fetch async output as one item per row.

Examples

Example 1: Scrape a different page with an existing recipe and wait for the result

Recipe: pick from list; Source URL: https://example.com/product/42; Run Asynchronously: off

Example 2: Bulk-scrape a list of product pages, then fetch results later

Recipe: by ID; URLs: add each page URL; Run Asynchronously: on. Pass the returned results_id to Get Results by ID.

Example 3: Get page content as Markdown for an LLM pipeline

Recipe: pick from list; Extract Markdown: on; Run Asynchronously: off

Links

Discussion