Actions18
- Get Duplicate Content
- Get Duplicate Tags
- Get Keyword Density
- Get Lighthouse Audit Results
- Get Links
- Get Live Instant Pages
- Get Live Lighthouse Audit Results
- Get Live Parsed Content
- Get Microdata
- Get Non-Indexable Pages
- Get Page Screenshot
- Get Pages
- Get Pages By Resource
- Get Parsed Content
- Get Raw HTML
- Get Redirect Chains
- Get Resources
- Get Waterfall
Get Parsed Content
AI-generatedSummary
Get Parsed Content retrieves the structured content of a specific web page, including link URLs, anchors, headings, and textual content. Optionally the content can be returned as Markdown. The operation configures a crawl using the DataForSEO OnPage API, allowing control over target domain, crawl limits, depth, delays, resource handling, JavaScript, browser emulation, and many other settings.
Inputs
- url_required (required) — Absolute URL of the page to parse (e.g., example.com/page).
- markdown_view — If true, returns the page content as Markdown in the page_as_markdown field.
- target — Domain to crawl (without https:// and www).
- max_crawl_pages — Maximum number of pages to crawl; set to 1 for a single page.
- start_url — Starting URL for crawling; if omitted, uses url_required.
- max_crawl_depth — Maximum crawl depth.
- crawl_delay — Delay between requests in milliseconds.
- store_raw_html — Whether to store the raw HTML of crawled pages.
- enable_content_parsing — Whether to parse content on crawled pages.
- support_cookies — Whether to support cookies on crawled pages.
- accept_language — Language header for accessing the website.
- custom_robots_txt — Custom robots.txt rules.
- robots_txt_merge_mode — Whether to merge or override the detected robots.txt with custom rules.
- custom_user_agent — Custom user agent string.
- browser_preset — Browser screen preset (desktop, mobile, tablet, empty).
- browser_screen_width — Browser screen width in pixels.
- browser_screen_height — Browser screen height in pixels.
- browser_screen_scale_factor — Browser screen scale factor (e.g., 1, 2).
- respect_sitemap — Whether to respect sitemap when crawling.
- custom_sitemap — Custom sitemap URL to use.
- crawl_sitemap_only — Crawl only pages listed in the sitemap.
- load_resources — Whether to load page resources (CSS, images, etc.) during crawl.
- enable_www_redirect_check — Check if the domain implements WWW redirection.
- enable_javascript — Enable JavaScript execution on crawled pages.
- enable_xhr — Enable XMLHttpRequest on crawled pages.
- enable_browser_rendering — Emulate browser rendering to measure Core Web Vitals.
- disable_cookie_popup — Attempt to dismiss cookie pop‑ups.
- custom_js — Custom JavaScript to inject on pages.
- validate_micromarkup — Validate microdata on crawled pages.
- allow_subdomains — Whether to include pages on subdomains.
- allowed_subdomains — List of subdomains to include in the crawl.
- disallowed_subdomains — List of subdomains to exclude from the crawl.
- check_spell — Enable spell checking of page content.
- check_spell_language — Language code for spell checking.
- check_spell_exceptions — Words to ignore during spell checking.
- calculate_keyword_density — Calculate keyword density for the target domain.
- checks_threshold — Custom threshold values for on‑page checks.
- disable_sitewide_checks — Sitewide checks to skip.
- disable_page_checks — Page‑level checks to skip.
- switch_pool — Switch proxy pool for the request.
- return_despite_timeout — Return partial data even if the request times out.
Output shape
object
Returns the DataForSEO OnPage API JSON response for the content parsing task. When markdown_view is true, the response includes a page_as_markdown field containing the Markdown‑formatted page content.