WellMarked icon

WellMarked

Convert any URL to clean Markdown using the WellMarked API

Actions9

Crawl Job → Submit

AI-generated

Summary

Submit a crawl job to the WellMarked API for the required Root URL. The node returns the API’s submission response, including the job ID, so you can check progress later with Get Status.

Inputs

  • Root URL (required) — URL where the crawl starts.
  • Depth — Maximum breadth-first crawl depth from the root URL; defaults to 1. Plan limits apply: Pro is capped at 5, Growth at 10, and Enterprise is unlimited.
  • Render JavaScript — Defaults to false. When enabled, fetches each page through Playwright so JavaScript-rendered content is included; this is significantly slower per page.
  • Output Format — Representation for each page: Markdown (default), JSON Blocks, Chunks, Raw HTML, or Links. JSON Blocks and Chunks require a Pro or higher plan.
  • Retry — Server-side retries per page after a timeout, each on a fresh connection. Defaults to 0, meaning one attempt.
  • Max Pages — Maximum successful pages to crawl. Defaults to 0, which leaves the plan’s page cap in effect; a specified limit can narrow but not exceed that cap.
  • Compliance Overrides — Optional request-level policy settings: Allow Domains restricts the crawl to listed domains and their subdomains; Deny Patterns excludes matching hostnames or URLs; Respect Robots selects Strict or Lax handling. Overrides can narrow the API key’s policy, not loosen it.

Output shape

A single n8n item containing the API’s job submission response.

The response includes a job ID for a later Get Status call. Each incoming item is submitted separately. A positive Max Pages value is sent as max_pages; zero is omitted. With Continue On Fail enabled, errors are returned as an item containing an error field.

Links

Discussion