MrScraper icon

MrScraper

Interact with the MrScraper API

Extraction → Extract Listings and Paginated Content

AI-generated

Summary

Scrapes paginated listing pages from a target URL, extracting structured data for each item based on an optional schema or natural language prompt.

Inputs

  • url (required) — The URL of the listing page (e.g., a search results page) to scrape.
  • prompt — Natural language instructions for what to extract from each listing page.
  • outputSchema — Optional JSON schema describing the expected shape of each extracted item.
  • maxPages — Maximum number of pagination pages to scrape (default: 1).
  • proxyCountry — ISO country code for the proxy (e.g., US, GB, ID, SG).
  • requestOptions — Collection of request options including batching, proxy, timeout, and SSL settings.

Output shape

A list of items, each representing a single listing record extracted from the pages.

Items are returned as a standard n8n item array. The specific fields extracted depend on the prompt or schema provided; fields not present in the source page will be omitted.

Examples

Example 1: Scrape property listings from a real estate search page, extracting title, price, and location.

Set URL to the property search page, provide a prompt to extract property details, and set maxPages to 3 to capture multiple result pages.

Example 2: Extract product information from an e-commerce search results page.

Enter the product search URL, optionally define an output schema for product fields, and enable batching to limit request rate.

Links

Discussion