Browserbase icon

Browserbase

Browser automation, web search, and page fetches with Browserbase.

Search → Fetch a Webpage

AI-generated

Overview

This node operation fetches the content of a specified webpage URL without starting a browser session. It is useful for scenarios where you need to retrieve raw HTML content, headers, and metadata from a webpage quickly and efficiently, such as for web scraping, content analysis, or monitoring website changes.

Use Case Examples

  1. Fetching the HTML content of a product page to extract pricing information.
  2. Retrieving headers and status codes from a webpage to check its availability.
  3. Downloading webpage content for offline processing or archiving.

Properties

Name Meaning
URL The URL of the webpage to fetch. This is a required string input where the user specifies the target webpage address.
Fetch Options Additional options to customize the fetch request, including whether to allow insecure SSL certificates, follow HTTP redirects, and use Browserbase proxies.

Output

JSON

  • url - The URL that was fetched.
  • statusCode - The HTTP status code returned by the fetch request.
  • headers - The HTTP headers returned by the server.
  • content - The raw content of the fetched webpage.
  • contentType - The MIME type of the fetched content.
  • encoding - The character encoding of the fetched content.

Dependencies

  • Requires an API key credential for Browserbase API access.

Troubleshooting

  • Common issues include invalid URLs, network errors, or API authentication failures.
  • Error messages may indicate problems with TLS verification if 'Allow Insecure SSL' is false and the server uses a self-signed certificate.
  • Ensure the API key credential is correctly configured and has necessary permissions.

Discussion