Actions7
- Agent Actions
- Fetch Actions
- Search Actions
Search → Fetch a Webpage
AI-generatedOverview
This node operation fetches the content of a specified webpage URL without starting a browser session. It is useful for scenarios where you need to retrieve raw HTML content, headers, and metadata from a webpage quickly and efficiently, such as for web scraping, content analysis, or monitoring website changes.
Use Case Examples
- Fetching the HTML content of a product page to extract pricing information.
- Retrieving headers and status codes from a webpage to check its availability.
- Downloading webpage content for offline processing or archiving.
Properties
| Name | Meaning |
|---|---|
| URL | The URL of the webpage to fetch. This is a required string input where the user specifies the target webpage address. |
| Fetch Options | Additional options to customize the fetch request, including whether to allow insecure SSL certificates, follow HTTP redirects, and use Browserbase proxies. |
Output
JSON
url- The URL that was fetched.statusCode- The HTTP status code returned by the fetch request.headers- The HTTP headers returned by the server.content- The raw content of the fetched webpage.contentType- The MIME type of the fetched content.encoding- The character encoding of the fetched content.
Dependencies
- Requires an API key credential for Browserbase API access.
Troubleshooting
- Common issues include invalid URLs, network errors, or API authentication failures.
- Error messages may indicate problems with TLS verification if 'Allow Insecure SSL' is false and the server uses a self-signed certificate.
- Ensure the API key credential is correctly configured and has necessary permissions.