Firecrawl icon

Firecrawl

Scrape, crawl, map, search, and extract structured data from websites using Firecrawl API

Crawling → List active crawls

AI-generated

Overview

This node interacts with the Firecrawl API to list active crawls. It is useful for users who want to monitor or retrieve information about ongoing web crawling tasks managed by Firecrawl. For example, it can be used to fetch the status of active crawls to track progress or manage crawl jobs.

Use Case Examples

  1. A user wants to see all currently active web crawls to monitor their status.
  2. A user integrates this node in a workflow to periodically check and log active crawl jobs for reporting purposes.

Properties

Name Meaning
Use Custom Body Determines whether to use a custom request body for the API call.
Request Options Settings to customize the HTTP request behavior, including batching, SSL certificate validation, proxy configuration, and timeout settings.

Output

JSON

  • activeCrawls - List of active crawl jobs retrieved from the Firecrawl API.

Dependencies

  • Firecrawl API
  • An API key credential for Firecrawl API authentication

Troubleshooting

  • Ensure the Firecrawl API credentials are correctly configured to avoid authentication errors.
  • If the request times out, consider increasing the timeout setting in Request Options.
  • If SSL certificate validation fails and you trust the endpoint, enable 'Ignore SSL Issues' to bypass SSL errors.
  • Check proxy settings if requests fail to connect through a corporate or custom proxy.

Links

Discussion