Skip to main content

PutAzureDataLakeStorage

Description

Writes the contents of a FlowFile as a file on Azure Data Lake Storage Gen 2

Tags

adlsgen2, azure, cloud, datalake, microsoft, storage

Properties

In the list below required Properties are shown with an asterisk (*). Other properties are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.

Display NameAPI NameDefault ValueAllowable ValuesDescription
ADLS Credentials *adls-credentials-serviceController Service:
ADLSCredentialsService

Implementations:
ADLSCredentialsControllerServiceLookup
ADLSCredentialsControllerService
Controller Service used to obtain Azure Credentials.
Filesystem Name *filesystem-nameName of the Azure Storage File System (also called Container). It is assumed to be already existing.

Supports Expression Language, using FlowFile attributes and Environment variables.
Directory Name *directory-nameName of the Azure Storage Directory. The Directory Name cannot contain a leading '/'. The root directory can be designated by the empty string value. In case of the PutAzureDataLakeStorage processor, the directory will be created if not already existing.

Supports Expression Language, using FlowFile attributes and Environment variables.
File Name *file-name${azure.filename}The filename

Supports Expression Language, using FlowFile attributes and Environment variables.
Writing Strategy *writing-strategyWrite and Rename
  • Write and Rename
  • Simple Write
Defines the approach for writing the Azure file.
Base Temporary Pathbase-temporary-pathThe Path where the temporary directory will be created. The Path name cannot contain a leading '/'. The root directory can be designated by the empty string value. Non-existing directories will be created.The Temporary File Directory name is _nifitempdirectory

Supports Expression Language, using FlowFile attributes and Environment variables.

This property is only considered if:
  • the property Writing Strategy has a value of WRITE_AND_RENAME
Conflict Resolution Strategy *conflict-resolution-strategyfail
  • fail
  • replace
  • ignore
Indicates what should happen when a file with the same name already exists in the output directory
Resource Transfer Source *Resource Transfer SourceFlowFile Content
  • FlowFile Content
  • File Resource Service
The source of the content to be transferred
File Resource Service *File Resource ServiceController Service:
FileResourceService

Implementations:
AzureBlobStorageFileResourceService
AzureDataLakeStorageFileResourceService
GCSFileResourceService
S3FileResourceService
StandardFileResourceService
File Resource Service providing access to the local resource to be transferred

This property is only considered if:
  • the property Resource Transfer Source has a value of FILE_RESOURCE_SERVICE
Proxy Configuration Serviceproxy-configuration-serviceController Service:
ProxyConfigurationService

Implementations:
StandardProxyConfigurationService
Specifies the Proxy Configuration Controller Service to proxy network requests. Supported proxies: SOCKS, HTTP In case of SOCKS, it is not guaranteed that the selected SOCKS Version will be used by the processor.

Dynamic Properties

This component does not support dynamic properties.

Relationships

NameDescription
failureFiles that could not be written to Azure storage for some reason are transferred to this relationship
successFiles that have been successfully written to Azure storage are transferred to this relationship

Reads Attributes

This processor does not read attributes.

Writes Attributes

NameDescription
azure.directoryThe name of the Azure Directory
azure.filenameThe name of the Azure File
azure.filesystemThe name of the Azure File System
azure.lengthThe length of the Azure File
azure.primaryUriPrimary location for file content

State Management

This component does not store state.

Restricted

This component is not restricted.

Input Requirement

This component requires an incoming relationship.

System Resource Considerations

This component does not specify system resource considerations.

See Also

DeleteAzureDataLakeStorage, FetchAzureDataLakeStorage, ListAzureDataLakeStorage