AI Scraper icon

AI Scraper

Scrape any Website with just a URL and Data Description using Parsera API (10K+ downloads)

Actions5

Extractor → Extract URL

AI-generated

Overview

The AI Scraper node with the Extractor resource and Extract URL operation allows users to scrape data from a specified webpage URL by providing a data description schema. It uses the Parsera API to extract structured data from the webpage content based on user-defined columns or JSON schema. This node is useful for automating data extraction from websites without manual parsing, such as extracting product details, prices, or other structured information from e-commerce or informational sites.

Use Case Examples

  1. Extract product names and prices from an e-commerce webpage by providing the URL and defining the data fields to extract.
  2. Scrape real estate listings from a property website by specifying the URL and a JSON schema describing the desired attributes.
  3. Extract news headlines and publication dates from a news website by entering the URL and column definitions.

Properties

Name Meaning
URL The URL of the webpage to extract data from. This is a required input for the extraction process.
Prompt (Optional) Optional prompt to provide context and general instructions for the data extraction process.
Columns Input Mode Select how to define columns for data extraction: either as separate fields or using a JSON schema. JSON mode is preferred for AI tool integration or complex schemas.
Columns Define data fields to extract when using 'Fields' input mode. Each column requires a name and type, with an optional description to specify what data to place in the column.
Schema (JSON) Define columns as a JSON object when using 'JSON' input mode. Each key is a field name, and its value is an object describing the data type and optional description.
Mode Extraction mode to balance speed and accuracy. 'Standard' is balanced, while 'Precision' extracts data hidden deeper in HTML.
Proxy Country Route the request through a proxy in the selected country to access geo-specific content.
Cookies Optional cookies provided as a JSON array of objects to include in the request for session or authentication purposes.

Output

JSON

  • data - The extracted structured data from the webpage according to the defined columns or JSON schema.

Dependencies

  • Parsera API
  • An API key credential for Parsera API

Troubleshooting

  • Common issues include invalid or unreachable URLs, incorrect data schema definitions leading to extraction errors, and network or proxy configuration problems.
  • Error messages may indicate authentication failures if the API key is invalid or missing, or timeout errors if the webpage is slow to respond. Ensuring correct URL format, valid API credentials, and proper proxy settings can resolve most issues.

Links

Discussion