Crawlora icon

Crawlora

Get structured web data from the public web via the Crawlora API

Actions166

Datasets → Datasets Techstack Search

AI-generated

Summary

Searches Crawlora’s website dataset for domains matching technology and site filters, returning a paginated result set. Supply the required API key and use the query fields to narrow, sort, and page through matching sites.

Inputs

  • Q — Optional substring to match against the site domain (up to 256 characters).
  • Technology — Repeatable exact technology names that each site must use; all listed technologies are required (AND).
  • Any Of — Repeatable exact technology names; a site must use at least one listed technology (OR).
  • Not — Repeatable exact technology names to exclude sites using any of them.
  • Category — Exact technology category, such as Ecommerce, CMS, Analytics, Payment, or CDN.
  • Cms — Exact CMS name filter, such as WordPress, Shopify, or Webflow.
  • Ecommerce — Exact e-commerce platform filter, such as Shopify, WooCommerce, or Magento.
  • Cdn — Exact CDN or hosting filter, such as Cloudflare, Fastly, or Vercel.
  • Web Server — Exact web server filter, such as nginx, Apache, or IIS.
  • Server Language — Exact server language or framework filter, such as PHP, ASP.NET, or Ruby on Rails.
  • Tld — Exact top-level-domain filter, such as com, org, or io.
  • Render Tier — Filter by fetch tier: http or browser. Defaults to http.
  • Seed Source — Filter by the source where the domain was discovered, such as tranco.
  • Has Captcha — Boolean filter for sites with a detected CAPTCHA. Defaults to true.
  • Is Infrastructure — Boolean filter for infrastructure hostnames. The property description recommends false to exclude backend CDN, DNS, or cloud-vendor hostnames and retain human-navigable sites; true selects those infrastructure hostnames. Defaults to true.
  • Reachable — Filter by whether the homepage could be fetched: true for fetched sites, false for sites that could not be fetched. Defaults to true.
  • Min Tech Count — Minimum number of detected technologies; 0 or greater. Defaults to 0.
  • Run Id — Scan run ID; leave empty to use the latest run.
  • Sort — Sort results by relevance, rank ascending, technology count descending, domain ascending, or crawl time descending. Defaults to relevance.
  • Page — Page number; the property description says the default is 1.
  • Page Size — Number of results per page; defaults to 20, maximum 100. The product of page and page size must not exceed 10,000.
  • X Api Key (required) — API key sent in the x-api-key request header.
  • Request Options — Optional HTTP request settings, including batching, proxy, timeout, and whether to accept invalid SSL certificates.

Output shape

A paginated set of matching dataset records returned by the Crawlora API.

The node declares an HTTP GET-style query routing for the listed filters against the API. The source pack does not include an operation executor or response transformation, so the exact response fields and pagination envelope are not shown.

Links

Discussion