ListUnityCatalogDirectory
Description
List file names in a Unity Catalog directory and output a new FlowFile with the filename.
Tags
databricks, unity catalog
Properties
In the list below required Properties are shown with an asterisk (*). Other properties are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.
| Display Name | API Name | Default Value | Allowable Values | Description |
|---|---|---|---|---|
| Databricks Client * | Databricks Client | Controller Service: DatabricksWorkspaceClientService Implementations: StandardDatabricksWorkspaceClientService | Databricks Client Service. | |
| Unity Catalog Directory Path * | Unity Catalog Directory Path | Unity Catalog directory path e.g. /Volumes/catalog/schema/volume_name/directory Supports Expression Language, using FlowFile attributes and Environment variables. | ||
| Recursive Directory Listing * | Recursive Directory Listing | true |
| Recursively list files in sub directories. |
| Include Directories * | Include Directories | true |
| Include directories in FlowFiles produced. |
Dynamic Properties
This component does not support dynamic properties.
Relationships
| Name | Description |
|---|---|
| failure | Databricks failure relationship |
| original | The original FlowFile is routed to this relationship when processing is successful. |
| success | Databricks success relationship |
Reads Attributes
This processor does not read attributes.
Writes Attributes
| Name | Description |
|---|---|
| absolute.path | Full path to the Unity Catalog file or directory. |
| error.code | The error code for the SQL statement if an error occurred. |
| error.message | The error message for the SQL statement if an error occurred. |
| filename | Base filename of the Unity Catalog file or directory. |
| path | Path to parent directory containing the Unity Catalog file or directory. |
| uc.lastModifiedTime | The last modified time of the Unity Catalog file in milliseconds since epoch in UTC time. |
| uc.resourceType | The type of resource, 'file' or 'directory' of the Unity Catalog resource. |
| uc.size | The size of the Unity Catalog file. |
State Management
This component does not store state.
Restricted
This component is not restricted.
Input Requirement
Input requirements are not specified for this component.
System Resource Considerations
This component does not specify system resource considerations.