Google Search
AI-generatedOverview
This node performs web scraping using Decodo's Web Scraping API, specifically supporting a Google Search operation. It allows users to input a search query and retrieve structured search results from Google. The node supports options such as enabling JavaScript rendering on pages, parsing results for structured data, setting geolocation and locale for the search, limiting the number of results per page, and choosing whether to retrieve results in markdown format. This node is useful for automating data extraction from Google Search results for analysis, monitoring, or integration into workflows.
Use Case Examples
- Extracting Google Search results for a specific query to analyze trends or gather information.
- Automating the retrieval of search results with geolocation and locale settings to compare regional search outcomes.
- Using the node to scrape search results with JavaScript rendering enabled to capture dynamically loaded content.
Properties
| Name | Meaning |
|---|---|
| Query | The target search query to scrape from Google Search. |
| JS Rendering | Whether pages are allowed to render content dynamically using JavaScript during scraping. |
| Parse | Whether to use dedicated parsers to retrieve structured data from the search results. |
| Geolocation | The country name from which the scraping request will be made, affecting search results regionally. |
| Locale | The language setting for the search page web interface (not the results). Example values: 'en-US', 'en-GB'. |
| Results Amount | Number of search results to retrieve per page, ranging from 1 to 100. |
| Markdown | Whether the search results are retrieved in markdown format. Only applicable when JavaScript rendering is disabled. |
Output
JSON
json- The scraped search results data returned from the Decodo Web Scraping API, structured according to the parsing settings.
Dependencies
- Decodo Web Scraping API
- An API key credential for Decodo API authentication
Troubleshooting
- Common issues include invalid or missing API credentials, which will cause authentication errors. Ensure the API key is correctly configured in the node credentials.
- If the query parameter is empty or invalid, the node will fail to retrieve results. Provide a valid search query string.
- Network or API service downtime can cause request failures; retry or check service status if errors occur.
- Parsing errors may occur if the structure of the Google Search results page changes; disabling parsing or adjusting parameters may help resolve this.
Links
- Decodo Web Scraping API Documentation - Official documentation for the Decodo Web Scraping API used by this node.