DataForSEO OnPage API icon

DataForSEO OnPage API

DataForSEO

Get Parsed Content

AI-generated

Summary

Get Parsed Content retrieves the structured content of a specific web page, including link URLs, anchors, headings, and textual content. Optionally the content can be returned as Markdown. The operation configures a crawl using the DataForSEO OnPage API, allowing control over target domain, crawl limits, depth, delays, resource handling, JavaScript, browser emulation, and many other settings.

Inputs

  • url_required (required) — Absolute URL of the page to parse (e.g., example.com/page).
  • markdown_view — If true, returns the page content as Markdown in the page_as_markdown field.
  • target — Domain to crawl (without https:// and www).
  • max_crawl_pages — Maximum number of pages to crawl; set to 1 for a single page.
  • start_url — Starting URL for crawling; if omitted, uses url_required.
  • max_crawl_depth — Maximum crawl depth.
  • crawl_delay — Delay between requests in milliseconds.
  • store_raw_html — Whether to store the raw HTML of crawled pages.
  • enable_content_parsing — Whether to parse content on crawled pages.
  • support_cookies — Whether to support cookies on crawled pages.
  • accept_language — Language header for accessing the website.
  • custom_robots_txt — Custom robots.txt rules.
  • robots_txt_merge_mode — Whether to merge or override the detected robots.txt with custom rules.
  • custom_user_agent — Custom user agent string.
  • browser_preset — Browser screen preset (desktop, mobile, tablet, empty).
  • browser_screen_width — Browser screen width in pixels.
  • browser_screen_height — Browser screen height in pixels.
  • browser_screen_scale_factor — Browser screen scale factor (e.g., 1, 2).
  • respect_sitemap — Whether to respect sitemap when crawling.
  • custom_sitemap — Custom sitemap URL to use.
  • crawl_sitemap_only — Crawl only pages listed in the sitemap.
  • load_resources — Whether to load page resources (CSS, images, etc.) during crawl.
  • enable_www_redirect_check — Check if the domain implements WWW redirection.
  • enable_javascript — Enable JavaScript execution on crawled pages.
  • enable_xhr — Enable XMLHttpRequest on crawled pages.
  • enable_browser_rendering — Emulate browser rendering to measure Core Web Vitals.
  • disable_cookie_popup — Attempt to dismiss cookie pop‑ups.
  • custom_js — Custom JavaScript to inject on pages.
  • validate_micromarkup — Validate microdata on crawled pages.
  • allow_subdomains — Whether to include pages on subdomains.
  • allowed_subdomains — List of subdomains to include in the crawl.
  • disallowed_subdomains — List of subdomains to exclude from the crawl.
  • check_spell — Enable spell checking of page content.
  • check_spell_language — Language code for spell checking.
  • check_spell_exceptions — Words to ignore during spell checking.
  • calculate_keyword_density — Calculate keyword density for the target domain.
  • checks_threshold — Custom threshold values for on‑page checks.
  • disable_sitewide_checks — Sitewide checks to skip.
  • disable_page_checks — Page‑level checks to skip.
  • switch_pool — Switch proxy pool for the request.
  • return_despite_timeout — Return partial data even if the request times out.

Output shape

object

Returns the DataForSEO OnPage API JSON response for the content parsing task. When markdown_view is true, the response includes a page_as_markdown field containing the Markdown‑formatted page content.

Links

Discussion