Read Files from URLInstall

Summary

Download files from a URL and optionally parse their content

Inputs

• url (required) — The URL of the file to download
• authentication — The authentication method to use (None, Basic Auth, Bearer Token, API Key, Custom Header)
• username — Username for Basic Auth
• password — Password for Basic Auth
• token — Bearer token for token-based authentication
• apiKeyName — Name of the API key header or query parameter
• apiKeyValue — Value of the API key
• apiKeyLocation — Where to send the API key (Header or Query Parameter)
• customHeaderName — Name of the custom authentication header
• customHeaderValue — Value of the custom authentication header
• parseContent — Whether to parse file content into structured data (JSON, YAML, XML, CSV, Excel)
• fileFormat — Specifies how to parse the file (Auto Detect, JSON, YAML, XML, CSV, Excel)
• options — Configuration options for file handling such as file name, mime type, timeout, etc.

Output shape

an array of objects each representing a processed file, containing binary data and optional parsed content metadata

Each item includes fields like url, mimeType, fileType, fileName, parsed, parsedFormat; if parsing fails and continueOnFail is enabled, items may contain an error field; otherwise the node returns success/failure only

Examples

Example 1: Download a JSON file and parse it

url set to file URL, parseContent true, fileFormat auto

Example 2: Download a file using Basic Auth

authentication basicAuth, username and password provided, parseContent false

Example 3: Download a binary PDF and store it in field 'data'

parseContent false, options dataPropertyName data, fileName document.pdf