Social Fetch icon

Social Fetch

Fetch social media and web data via the Social Fetch API

Actions129

Web → Crawl

AI-generated

Summary

Crawls the supplied web pages by sending their URLs to the Web Crawl endpoint. Use it to fetch up to five pages in one operation; configure request options to control batching, SSL validation, proxy use, or timeout.

Inputs

  • URL (required) — One or more URLs to crawl. The node repeats the url query parameter for each URL; the UI description limits this to 5 pages.
  • Request Options — Optional request settings: batching splits requests into batches (default 50 items, 1000 ms between batches; -1 disables batching, and 0 items is treated as 1), Ignore SSL Issues accepts responses with invalid or unverifiable certificates, Proxy sets an HTTP proxy URL, and Timeout sets the wait for response headers in milliseconds (default 10000).

Output shape

Not determinable from the provided source pack.

The operation's implementation body is omitted, so the returned data shape and crawl side effects cannot be established from the available source.

Links

Discussion