Databricks icon

Databricks

Interact with Databricks API

Actions33

Files → Delete File

AI-generated

Overview

This node operation deletes a specified file from a Databricks Unity Catalog volume. It requires the user to provide the full volume path in the format 'catalog.schema.volume' and the file path within that volume. The node sends a DELETE HTTP request to the Databricks API to remove the file. This operation is useful for managing and cleaning up files stored in Databricks Unity Catalog volumes, such as removing outdated or unnecessary files programmatically.

Use Case Examples

  1. Deleting a log file from a specific volume after processing.
  2. Removing temporary files from a data volume to free up space.

Properties

Name Meaning
Volume Path Full path to the volume in the format 'catalog.schema.volume' (e.g., main.default.my_volume). This specifies the location of the volume containing the file to delete.
File Path Path to the file within the specified volume (e.g., 'folder/file.txt' or 'file.txt'). The path should not include a leading slash.

Output

JSON

  • success - Indicates whether the file deletion was successful (true/false).
  • message - A message confirming the file was deleted successfully, including the file path.
  • volumePath - The full volume path where the file was located.
  • filePath - The path of the deleted file within the volume.

Dependencies

  • Databricks API with an API token for authentication

Troubleshooting

  • Ensure the volume path is correctly formatted as 'catalog.schema.volume'. Incorrect formatting will cause an error.
  • Verify that the file path is correct and the file exists; otherwise, the API may return an error.
  • Check that the API token has sufficient permissions to delete files in the specified volume.
  • Network or API errors will be logged; enabling 'continue on fail' allows the workflow to proceed despite errors.

Links

  • Databricks Files API - Official documentation for managing files in Databricks Unity Catalog volumes.

Discussion