DataGait icon

DataGait

Scrape, crawl, and extract structured data from JavaScript-heavy websites using DataGait API

Actions6

Scrape Text

AI-generated

Summary

Scrape clean text content, page title, and URL from a specified webpage using the DataGait API, suitable for LLM and AI processing.

Inputs

  • URL (required) — The URL of the webpage from which to extract the text content.
  • Timeout (Seconds) — Maximum time to wait for page load and JavaScript execution, from 1 to 300 seconds, defaulting to 15 seconds.
  • Allow External Scripts — Option to allow execution of cross-origin scripts (default is same-origin only).

Output shape

a single JSON object containing the scraped URL, page title, extracted clean text content, and timing in milliseconds

The output includes the fields 'url', 'title', 'text', and 'timing_ms'. Errors during execution return error messages unless the node is configured to continue on fail.

Links

Discussion