Skip to main content

ExecuteStreamCommand

Description

The ExecuteStreamCommand processor provides a flexible way to integrate external commands and scripts into NiFi data flows. ExecuteStreamCommand can pass the incoming FlowFile's content to the command that it executes similarly how piping works.

Tags

command, command execution, execute, stream

Properties

In the list below required Properties are shown with an asterisk (*). Other properties are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.

Display NameAPI NameDefault ValueAllowable ValuesDescription
Working DirectoryWorking DirectoryThe directory to use as the current working directory when executing the command

Supports Expression Language, using FlowFile attributes and Environment variables.
Command Path *Command PathSpecifies the command to be executed; if just the name of an executable is provided, it must be in the user's environment PATH.

Supports Expression Language, using FlowFile attributes and Environment variables.
Command Arguments StrategyargumentsStrategyCommand Arguments Property
  • Command Arguments Property
  • Dynamic Property Arguments
Strategy for configuring arguments to be supplied to the command.
Command ArgumentsCommand ArgumentsThe arguments to supply to the executable delimited by the ';' character.

Supports Expression Language, using FlowFile attributes and Environment variables.

This property is only considered if:
  • the property Command Arguments Strategy has a value of Command Arguments Property
Argument Delimiter *Argument Delimiter;Delimiter to use to separate arguments for a command [default: ;]. Must be a single character

This property is only considered if:
  • the property Command Arguments Strategy has a value of Command Arguments Property
Ignore STDINIgnore STDINfalse
  • true
  • false
If true, the contents of the incoming flowfile will not be passed to the executing command
Output Destination AttributeOutput Destination AttributeIf set, the output of the stream command will be put into an attribute of the original FlowFile instead of a separate FlowFile. There will no longer be a relationship for 'output stream' or 'nonzero status'. The value of this property will be the key for the output attribute.
Max Attribute LengthMax Attribute Length256If routing the output of the stream command to an attribute, the number of characters put to the attribute value will be at most this amount. This is important because attributes are held in memory and large attributes will quickly cause out of memory issues. If the output goes longer than this value, it will truncated to fit. Consider making this smaller if able.
Output MIME TypeOutput MIME TypeSpecifies the value to set for the "mime.type" attribute. This property is ignored if 'Output Destination Attribute' is set.

Dynamic Properties

NameValueDescription
An environment variable nameAn environment variable valueThese environment variables are passed to the process spawned by this Processor

Supports Expression Language: No
command.argument.<commandIndex>Argument to be supplied to the commandThese arguments are supplied to the process spawned by this Processor when using the Command Arguments Strategy : Dynamic Property Arguments. <commandIndex> is a number and it will determine the order.

Supports Expression Language: No

Relationships

NameDescription
nonzero statusThe destination path for the flow file created from the command's output, if the returned status code is non-zero. All flow files routed to this relationship will be penalized.
originalThe original FlowFile will be routed. It will have new attributes detailing the result of the script execution.
output streamThe destination path for the flow file created from the command's output, if the returned status code is zero.

Reads Attributes

This processor does not read attributes.

Writes Attributes

NameDescription
execution.commandThe name of the command executed
execution.command.argsThe semi-colon delimited list of arguments. Sensitive properties will be masked
execution.errorAny error messages returned from executing the command
execution.statusThe exit status code returned from executing the command
mime.typeSets the MIME type of the output if the 'Output MIME Type' property is set and 'Output Destination Attribute' is not set

State Management

This component does not store state.

Restricted

Required PermissionExplanation
execute codeProvides operator the ability to execute arbitrary code assuming all permissions that NiFi has.

Input Requirement

This component requires an incoming relationship.

System Resource Considerations

This component does not specify system resource considerations.

See Also