Actions16
- Marketplace Dataset Actions
- Web Scraper Actions
- Web Unlocker Actions
Web Unlocker → Send a Request
AI-generatedOverview
The Web Unlocker node in the BrightData integration allows users to send HTTP requests through a specified zone and country to unlock web content that might be restricted or protected. It supports various HTTP methods (GET, POST, PUT, DELETE, PATCH, HEAD) and lets users specify the target URL, response format (raw or JSON), and optional markdown formatting. This node is useful for scenarios where web scraping or data extraction is needed from sites with geo-restrictions or anti-bot measures, enabling access to content as if from different locations or zones.
Use Case Examples
- Sending a GET request to a geo-restricted news website using a US zone to retrieve the latest headlines.
- Posting data to a web form behind a firewall using a specific zone to bypass restrictions.
- Fetching JSON data from an API endpoint that requires requests to originate from a particular country.
Properties
| Name | Meaning |
|---|---|
| Zone | Select the zone through which the request will be routed, enabling access to content restricted by location or network. |
| Country | Select the country to simulate the request origin, useful for bypassing geo-restrictions. |
| Method | The HTTP method to use for the request, such as GET, POST, PUT, DELETE, PATCH, or HEAD. |
| URL | The URL to which the HTTP request will be sent. |
| Data Format | Optionally format the response as Markdown, which forces the response format to raw. |
| Format | The format of the response data, either raw or JSON. This option is disabled if Data Format is set to Markdown. |
| Request Options | Additional request options such as batching, SSL certificate validation, proxy settings, and timeout configuration. |
Output
JSON
response- The HTTP response received from the requested URL, formatted according to the selected response format (raw or JSON).
Dependencies
- Requires an API key credential for BrightData to authenticate and authorize requests.
Troubleshooting
- Common issues include invalid zone or country selections, which can cause request failures or unexpected responses.
- Timeout errors may occur if the server does not respond within the specified timeout period; increasing the timeout or checking network connectivity can help.
- SSL certificate validation errors can be bypassed by enabling the 'Ignore SSL Issues' option, but this may expose security risks.
- Incorrect HTTP method or malformed URL can lead to request errors; ensure the method and URL are valid and properly formatted.