Overview

This node converts a given URL of a web page into markdown format using the WebCrawlerAPI. It is useful for scenarios where you want to extract and transform web page content into markdown for easier readability, documentation, or further processing. For example, converting blog posts, articles, or documentation pages into markdown format automatically.

Use Case Examples

1. Convert a blog post URL to markdown to include in a markdown-based documentation system.
2. Extract content from a news article URL and convert it to markdown for content analysis or archiving.

Properties

Output

JSON

• json
  • success - Indicates if the API request was successful.
  • status - Status code returned by the API.
  • error_message - Error message if the API request failed.
  • data - The main data object containing the markdown content and related information returned from the API.

Dependencies

• Requires an API key credential for WebCrawlerAPI to authenticate requests.

Troubleshooting

• Common errors include network issues, invalid URLs, or API authentication failures. Ensure the URL is valid and accessible.
• If the API returns an error status, check the error message for details and verify the API key credentials.
• Timeouts or slow responses may occur if the target web page is large or the API service is experiencing high load.

Links

• WebCrawlerAPI Documentation - Official documentation for the WebCrawlerAPI service used by this node.