Actions7
- Agent Actions
- Fetch Actions
- Search Actions
Fetch → Fetch a Webpage
AI-generatedOverview
This node operation fetches a webpage by making an HTTP POST request to the Browserbase API's fetch endpoint. It allows users to specify a URL and configure fetch options such as allowing insecure SSL certificates, following HTTP redirects, and using Browserbase proxies. The node is useful for scenarios where you need to retrieve the content of a webpage without starting a full browser session, such as scraping static content or checking page status.
Use Case Examples
- Fetching the HTML content of a public webpage for data extraction.
- Checking the HTTP status and headers of a URL to monitor website health.
- Retrieving webpage content while bypassing SSL certificate verification for testing purposes.
Properties
| Name | Meaning |
|---|---|
| URL | The URL of the webpage to fetch. This is a required string input where the user specifies the target webpage address. |
| Fetch Options | A collection of optional settings to control the fetch behavior, including allowing insecure SSL, following redirects, and using proxies. |
Output
JSON
url- The URL that was fetched.statusCode- The HTTP status code returned by the fetch request.headers- The HTTP headers returned by the fetch request.content- The content of the fetched webpage, typically HTML or other text content.contentType- The MIME type of the fetched content.encoding- The character encoding of the fetched content.
Dependencies
- Browserbase API key credential
Troubleshooting
- Ensure the URL is valid and starts with http:// or https:// to avoid request errors.
- If the fetch fails due to SSL issues, try enabling the 'Allow Insecure SSL' option to bypass certificate verification.
- If the webpage redirects and you want to follow redirects, enable the 'Allow Redirects' option.
- Check that the Browserbase API key credential is correctly configured and has the necessary permissions.