Spider icon

Spider

Crawl and scrape websites using the Spider API

Actions7

Transform

AI-generated

Summary

Fetch the content of a specified URL and convert it into a chosen format such as Markdown, HTML, Plain Text, or XML.

Inputs

  • URL (required) — The URL of the web page to process.
  • Return Format (required) — The desired format for the extracted content: Markdown, HTML, Plain Text, or XML.
  • Additional Fields — Optional parameters including anti-bot bypass, proxy usage, headless browser rendering, inclusion of metadata, and readability mode to extract main article content.

Output shape

a single item containing the transformed content in the specified format

Returns the transformed page content as a JSON object. If multiple results occur, only the first is returned as a single item. Errors can be returned in the JSON with an error message if Continue On Fail is enabled.

Examples

Example 1: Transform a web page to Markdown

Set operation to Transform, enter the target URL, select 'Markdown' as the Return Format, and optionally enable readability mode to extract main article content.

Links

Discussion