ListDBFSDirectory
Description
List file names in a DBFS directory and output a new FlowFile with the filename.
Tags
databricks, dbfs
Properties
In the list below required Properties are shown with an asterisk (*). Other properties are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.
| Display Name | API Name | Default Value | Allowable Values | Description |
|---|---|---|---|---|
| Databricks Client * | Databricks Client | Controller Service: DatabricksWorkspaceClientService Implementations: StandardDatabricksWorkspaceClientService | Databricks Client Service. | |
| DBFS File Path * | DBFS File Path | DBFS file path e.g. /directory/file.txt Supports Expression Language, using FlowFile attributes and Environment variables. | ||
| Recursive Directory Listing * | Recursive Directory Listing | true |
| Recursively list files in sub directories. |
| Include Directories * | Include Directories | true |
| Include directories in FlowFiles produced. |
Dynamic Properties
This component does not support dynamic properties.
Relationships
| Name | Description |
|---|---|
| failure | Databricks failure relationship |
| original | The original FlowFile is routed to this relationship when processing is successful. |
| success | Databricks success relationship |
Reads Attributes
This processor does not read attributes.
Writes Attributes
| Name | Description |
|---|---|
| absolute.path | Full path to the DBFS file or directory. |
| dbfs.lastModifiedTime | The last modified time of the DBFS file, in milliseconds since epoch in UTC time. |
| dbfs.resourceType | The type of resource, 'file' or 'directory' of the DBFS resource. |
| dbfs.size | The size of the DBFS file. |
| error.code | The error code for the SQL statement if an error occurred. |
| error.message | The error message for the SQL statement if an error occurred. |
| filename | Base filename of the DBFS file or directory. |
| path | Path to parent directory containing the DBFS file or directory. |
State Management
This component does not store state.
Restricted
This component is not restricted.
Input Requirement
Input requirements are not specified for this component.
System Resource Considerations
This component does not specify system resource considerations.