MrScraper icon

MrScraper

Interact with the MrScraper API

Actions14

Scraper Run → Run Existing Scraper

AI-generated

Summary

Runs an existing MrScraper scraper against a required URL. Choose the scraper type and, for AI scrapers, the agent type; optional settings control retries, proxy country, extraction output, pagination or URL discovery, and manual scraper behavior.

Inputs

  • Scraper Type (required) — Select AI (default) or Manual to choose the scraper API endpoint.
  • Agent Type (required) — For AI scrapers, choose General, Listing, or Map. General and Listing expose extraction options; Listing also has page and timeout limits. Map exposes crawl depth, page and result limits, and URL include/exclude patterns.
  • Scraper ID (required) — ID of the existing scraper.
  • URL (required) — Full URL to process.
  • Max Retry — Maximum retry attempts; defaults to 3.
  • Proxy Country — Proxy country code; blank values are omitted.
  • Options — For AI General or Listing runs, controls proxy bypass, HTML or Markdown output, JavaScript rendering, cookies, screenshots, home-page visits, and a selector to wait for. Listing also supports streaming. For Manual runs, controls proxy bypass, cookie jar or cookies, home-page visit and timeout, HTML or Markdown output, pagination configuration, proxy, session recording, cookie return, screenshot, streaming, timeout, and token cap.
  • Max Pages — For AI Listing runs, maximum pagination pages (default 5); for AI Map runs, maximum pages evaluated during URL discovery (default 50).
  • Timeout — For AI Listing runs, maximum wait in seconds (default 300); Manual runs have a separate timeout option (default 600).
  • Max Depth — For AI Map runs, maximum link depth from the starting URL; defaults to 2.
  • Limit — For AI Map runs, maximum results to return; defaults to 50.
  • Include Patterns — For AI Map runs, pipe-separated regular expressions matching URLs to include; blank values are omitted.
  • Exclude Patterns — For AI Map runs, pipe-separated regular expressions matching URLs to exclude; blank values are omitted.

Output shape

A single API response item for the scraper run.

The provided source pack contains no executable bodies, so it does not establish the response fields, whether streaming changes the returned shape, or additional runtime behavior. Output content is controlled in part by the selected scraper and options.

Links

Discussion