Firecrawl icon

Firecrawl

Scrape, crawl, map, search, and extract structured data from websites using Firecrawl API

Actions31

Agent → Get Agent Status

AI-generated

Overview

This node operation retrieves the status of a specific agent job by its ID using the Firecrawl API. It is useful for monitoring the progress and results of web scraping or data extraction tasks initiated through the Firecrawl platform. For example, users can check if a job is still processing, completed, or failed, and access extracted data, credits used, and expiration time of the job results.

Use Case Examples

  1. A user submits a web scraping job to Firecrawl and later uses this node to check if the job has completed and to retrieve the extracted data.
  2. A user monitors multiple agent jobs to track their statuses and manage API usage credits.

Properties

Name Meaning
Agent Job ID The unique identifier of the agent job to get status for. This is required to specify which job's status to retrieve.
Use Custom Body A boolean flag to indicate whether to use a custom request body instead of the default.
Request Options Additional request settings such as batching, SSL certificate validation, proxy configuration, and timeout settings to customize the HTTP request behavior.

Output

JSON

  • status - The current status of the agent job (e.g., processing, completed, failed).
  • extractedData - The data extracted by the agent job if completed successfully.
  • creditsUsed - The number of API credits consumed by the agent job.
  • expirationTime - The time until which the job results are available (results expire 24 hours after completion).

Dependencies

  • Firecrawl API key credential

Troubleshooting

  • Ensure the Agent Job ID is correct and exists; otherwise, the API may return an error or no data.
  • If the job status is not updating, verify that the job has been submitted and is still within the 24-hour result availability window.
  • Check network settings if using proxy or custom SSL options to avoid connection issues.
  • Timeout errors may occur if the server is slow to respond; consider increasing the timeout setting.

Links

Discussion