ScrapegraphAI icon

ScrapegraphAI

Turn any webpage into usable data with the ScrapeGraphAI v2 API — scrape, extract, search, crawl, monitor, history, credits.

Actions19

Crawl → Resume

AI-generated

Overview

This node operation resumes a paused or stopped crawl job in the ScrapegraphAI system. It is useful when you want to continue a web crawling task that was previously interrupted without starting over. For example, if a crawl job was paused due to resource constraints or manual intervention, this operation allows you to resume it seamlessly.

Use Case Examples

  1. Resuming a paused crawl job to continue data collection from a website.
  2. Restarting a stopped crawl job after fixing an issue that caused the stop.

Properties

Name Meaning
Crawl Job The specific crawl job to act on, identified either by selecting from a list of available crawls or by providing the crawl job's UUID.

Output

JSON

  • json - The JSON output contains the result of the resume operation, such as status confirmation or error details if the operation failed.

Dependencies

  • Requires an API key credential for ScrapegraphAI to authenticate and authorize the resume operation.

Troubleshooting

  • If the crawl ID is invalid or not found, the node will throw an error indicating the crawl job could not be located. Verify the UUID format and existence of the crawl job.
  • If the operation is unsupported for the given resource or operation combination, an error will be thrown. Ensure the resource is 'Crawl' and operation is 'Resume'.
  • Network or API errors may occur; enabling 'Continue On Fail' allows the workflow to handle errors gracefully by outputting error details instead of stopping execution.

Discussion