CRW

Scrape, crawl, and extract web data with CRW — the open-source web scraper built for AI agents

Search

AI-generated

Summary

Performs a web search using the CRW API and returns result items, optionally scraping the content of each result.

Inputs

  • query (required) — The search query string.
  • limit — Maximum number of search results to return (default: 5).
  • searchOptions — Additional search configuration including language, time filter, sources, and whether to scrape results.

Output shape

One or more items, each representing a single search result.

If 'Scrape Results' is enabled, each item includes the scraped content of that result. If only 'Scrape Results' is false, items contain only the search result metadata.

Examples

Example 1: Basic web search

Query: 'n8n automation', Limit: 10

Example 2: Search with time filter and scraping

Query: 'latest AI news', Time Filter: 'Past Day', Scrape Results: true

Example 3: Search restricted to images

Query: 'nature', Sources: ['Images']

Links

Discussion