1001fx - NoCode functionsInstall

Overview

The Scrape HTML operation under the data resource in this custom n8n node allows users to extract specific information from an HTML string or a website URL using CSS selectors. This is particularly useful for automating data extraction tasks such as web scraping, content aggregation, or monitoring changes on web pages.

Common scenarios:

• Extracting product details (price, title, image) from e-commerce sites.
• Collecting article headlines or summaries from news websites.
• Gathering structured data from any public webpage for further processing in your automation workflows.

Practical example:
You could use this node to scrape all links (<a> tags with href attributes) from a given HTML page and output them as structured JSON for downstream processing.

Properties

Output

• The output is a JSON object containing the extracted data based on the provided selectors.
• Each key in the output corresponds to the "Key Field" specified in the selector configuration, and its value is the extracted content (attribute value or text) from the matched element(s).
• If multiple selectors are used, the output will include multiple fields accordingly.

Example output:

{
  "title": "Example Page Title",
  "mainLink": "https://example.com",
  "imageSrc": "https://example.com/image.jpg"
}

• The node does not output binary data for this operation.

Dependencies

• External Service: Requires access to the 1001fx API.
• API Key: You must configure the 1001fxApi credential in n8n.
• Network Access: The n8n instance must be able to reach external URLs if scraping live websites.

Troubleshooting

Common issues:

• Invalid Selectors: If a selector does not match any elements, the corresponding field may be empty or missing in the output.
• Malformed HTML: Supplying invalid HTML in the "HTML String" property can result in incomplete or incorrect extraction.
• Network Errors: When scraping a website, network issues or inaccessible URLs will cause errors.
• Authentication Required: Scraping protected or login-required pages will fail unless proper authentication is handled upstream.

Error messages:

• "error": "Request failed with status code 404" – The target website was not found. Check the URL.
• "error": "Invalid JSON in selectors" – The selectors input is not valid JSON. Double-check your input format.
• "error": "Missing required parameter" – Ensure all required properties are filled.

Resolution tips:

• Always test your selectors using browser dev tools before using them in the node.
• For large or complex pages, consider limiting the number of selectors or refining them for better performance.

Links and References

• 1001fx API Documentation
• CSS Selectors Reference (MDN)
• n8n Documentation