(AI) WebpageScraper icon

(AI) WebpageScraper

Scrape content from webpages using AI models

(AI) WebpageScraper

AI-generated

Summary

Scrape a webpage using AI models on the CommunityAPI AI Server. The operation accepts a URL and optional flags for clips and advanced WhisperX processing, posts to the API, and returns the result on the main output. Callbacks support job completion notifications.

Inputs

  • url (required) — The URL to scrape content from
  • include_clips — Whether to include video/audio clips in the scraping
  • use_x — Whether to use more advanced WhisperX engine. Only sent when include_clips is enabled.
  • callback_url — Optional URL that will be called when the job is completed
  • callback_payload — Custom data that will be returned with the job completion notification

Output shape

main

API response JSON attached to the main output item.

Links

Discussion