NGTRGIABAO - Extract Website Content icon

NGTRGIABAO - Extract Website Content

Extract content from a website

NGTRGIABAO - Extract Website Content

AI-generated

Summary

Analyzed the NGTRGIABAO - Extract Website Content node operation. The node fetches a website URL via axios, uses cheerio to parse HTML removing scripts/styles/nav/footer/ad elements, extracts body text (whitespace-normalized), body HTML, and converts to markdown via turndown. Returns a JSON object with url and format-specific fields (html/text/markdown/clean) based on the outputFormat selection.

Inputs

  • url (required) — Website URL to extract content from
  • outputFormat — Format selection: html/text/markdown/clean/all, default is 'all'

Output shape

json object containing url plus format-specific fields (html/text/markdown/clean) based on selection

Returns single main output item with json data

Examples

Example 1: Extract HTML format

Set outputFormat to 'html' or 'all' to receive the raw fetched page HTML alongside the url

Example 2: Extract Text format

Set outputFormat to 'text' or 'all' to receive cleaned body text alongside the url

Example 3: Extract Markdown format

Set outputFormat to 'markdown' or 'all' to receive turndown-converted markdown alongside the url

Discussion