Actions52
- AI Scraper Actions
- Airbnb Actions
- AppStore Actions
- Booking Actions
- Company Insight Actions
- Company Website Finder Actions
- Emails & Contact Actions
- Expedia Actions
- G2 Review Actions
- Geocoding Actions
- GetApp Review Actions
- Google Map Actions
- Google Search Actions
- Indeed Actions
- Phone Identity Finder Actions
- Phones Owner Actions
- Product Hunt Actions
- Similarweb Actions
- Target Review Actions
- TikTok Profile Actions
- TripAdvisor Actions
- Trustpilot Actions
- Twitter Profile Actions
- Universal AI Scraper Actions
- Walmart Review Actions
- WebPage Screenshoter Actions
- Whitepages Addresses Scraper Actions
- Yellow Pages Search Actions
- Yelp Actions
- YouTube Actions
- Zillow Actions
Universal AI Scraper → Scrape
AI-generatedOverview
The Universal AI Scraper node interacts with the Outscraper API to scrape data from web pages based on user-defined queries and attributes. It is useful for extracting structured information from various web pages by specifying URLs and the attributes to parse. This node supports asynchronous requests and webhook callbacks for task completion notifications, making it suitable for automated data extraction workflows and integration with other systems.
Use Case Examples
- Scraping product details from e-commerce pages by providing product URLs and specifying attributes like price, description, and reviews.
- Extracting contact information from company websites by inputting URLs and defining attributes such as phone numbers and email addresses.
- Collecting user reviews or ratings from review sites by specifying the review page URLs and desired data fields.
Properties
| Name | Meaning |
|---|---|
| Query | Links to web pages to scrape, e.g., https://www.apple.com/iphone/ |
| Attributes | Attributes to parse from the web page, specified as a comma-separated list. |
| Limit | Maximum number of results to return from the scraping operation. |
| Async Request | Flag to indicate whether the scraping request should be made asynchronously. |
| Webhook | URL to which Outscraper will send a POST request once the scraping task is finished. |
| Additional Fields | Optional additional parameters including specific fields to return and whether to execute the request as a UI task. |
| Request Options | Node-level request options such as batching, SSL certificate validation, proxy settings, and request timeout. |
Output
JSON
results- Array of scraped data results from the web pages.
Dependencies
- Outscraper API key credential
Troubleshooting
- Ensure the provided URLs in the Query property are valid and accessible to avoid request failures.
- If asynchronous requests are used, verify that the webhook URL is correctly configured to receive POST callbacks.
- Check proxy settings and SSL options if requests fail due to network or certificate issues.
- Adjust the Limit property to avoid exceeding API rate limits or request timeouts.
Links
- Outscraper API Documentation - Official documentation for the Outscraper API, including usage and parameters.