Skip to main content

CSVRecordSetWriter

Description

Writes the contents of a RecordSet as CSV data. The first line written will be the column names (unless the 'Include Header Line' property is false). All subsequent lines will be the values corresponding to the record fields.

Tags

csv, delimited, record, recordset, result, row, separated, serializer, set, tab, tsv, writer

Properties

In the list below required Properties are shown with an asterisk (*). Other properties are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.

Display NameAPI NameDefault ValueAllowable ValuesDescription
Schema Write Strategy *Schema Write StrategyDo Not Write Schema
  • Do Not Write Schema
  • Set 'schema.name' Attribute
  • Set 'avro.schema' Attribute
  • Schema Reference Writer
Specifies how the schema for a Record should be added to the data.
Schema Cacheschema-cacheController Service:
RecordSchemaCacheService

Implementations:
VolatileSchemaCache
Specifies a Schema Cache to add the Record Schema to so that Record Readers can quickly lookup the schema.
Schema Reference Writer *Schema Reference WriterController Service:
SchemaReferenceWriter

Implementations:
ConfluentEncodedSchemaReferenceWriter
Service implementation responsible for writing FlowFile attributes or content header with Schema reference information

This property is only considered if:
  • the property Schema Write Strategy has a value of schema-reference-writer
Schema Access Strategy *schema-access-strategyInherit Record Schema
  • Inherit Record Schema
  • Use 'Schema Name' Property
  • Use 'Schema Text' Property
Specifies how to obtain the schema that is to be used for interpreting the data.
Schema Registryschema-registryController Service:
SchemaRegistry

Implementations:
AmazonGlueSchemaRegistry
ApicurioSchemaRegistry
AvroSchemaRegistry
ConfluentSchemaRegistry
Specifies the Controller Service to use for the Schema Registry

This property is only considered if:
  • the property Schema Access Strategy has a value of schema-reference-reader or schema-name
Schema Nameschema-name${schema.name}Specifies the name of the schema to lookup in the Schema Registry property

Supports Expression Language, using FlowFile attributes and Environment variables.

This property is only considered if:
  • the property Schema Access Strategy has a value of schema-name
Schema Versionschema-versionSpecifies the version of the schema to lookup in the Schema Registry. If not specified then the latest version of the schema will be retrieved.

Supports Expression Language, using FlowFile attributes and Environment variables.

This property is only considered if:
  • the property Schema Access Strategy has a value of schema-name
Schema Branchschema-branchSpecifies the name of the branch to use when looking up the schema in the Schema Registry property. If the chosen Schema Registry does not support branching, this value will be ignored.

Supports Expression Language, using FlowFile attributes and Environment variables.

This property is only considered if:
  • the property Schema Access Strategy has a value of schema-name
Schema Textschema-text${avro.schema}The text of an Avro-formatted Schema

Supports Expression Language, using FlowFile attributes and Environment variables.

This property is only considered if:
  • the property Schema Access Strategy has a value of schema-text-property
Schema Reference Reader *schema-reference-readerController Service:
SchemaReferenceReader

Implementations:
ConfluentEncodedSchemaReferenceReader
Service implementation responsible for reading FlowFile attributes or content to determine the Schema Reference Identifier

This property is only considered if:
  • the property Schema Access Strategy has a value of schema-reference-reader
Date FormatDate FormatSpecifies the format to use when reading/writing Date fields. If not specified, Date fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java java.time.format.DateTimeFormatter format (for example, MM/dd/yyyy for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters, as in 01/01/2017).
Time FormatTime FormatSpecifies the format to use when reading/writing Time fields. If not specified, Time fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java java.time.format.DateTimeFormatter format (for example, HH:mm:ss for a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 18:04:15).
Timestamp FormatTimestamp FormatSpecifies the format to use when reading/writing Timestamp fields. If not specified, Timestamp fields will be assumed to be number of milliseconds since epoch (Midnight, Jan 1, 1970 GMT). If specified, the value must match the Java java.time.format.DateTimeFormatter format (for example, MM/dd/yyyy HH:mm:ss for a two-digit month, followed by a two-digit day, followed by a four-digit year, all separated by '/' characters; and then followed by a two-digit hour in 24-hour format, followed by a two-digit minute, followed by a two-digit second, all separated by ':' characters, as in 01/01/2017 18:04:15).
CSV Format *CSV FormatCustom Format
  • Custom Format
  • RFC 4180
  • Microsoft Excel
  • Tab-Delimited
  • MySQL Format
  • Informix Unload
  • Informix Unload Escape Disabled
Specifies which "format" the CSV data is in, or specifies if custom formatting should be used.
CSV Writer *csv-writerApache Commons CSV
  • Apache Commons CSV
  • FastCSV
Specifies which writer implementation to use to write CSV records. NOTE: Different writers may support different subsets of functionality and may also exhibit different levels of performance.
Value Separator *Value Separator,The character that is used to separate values/fields in a CSV Record. If the property has been specified via Expression Language but the expression gets evaluated to an invalid Value Separator at runtime, then it will be skipped and the default Value Separator will be used.

Supports Expression Language, using FlowFile attributes and Environment variables.

This property is only considered if:
  • the property CSV Format has a value of custom
Include Header Line *Include Header Linetrue
  • true
  • false
Specifies whether or not the CSV column names should be written out as the first line.
Quote Character *Quote Character"The character that is used to quote values so that escape characters do not have to be used. If the property has been specified via Expression Language but the expression gets evaluated to an invalid Quote Character at runtime, then it will be skipped and the default Quote Character will be used.

Supports Expression Language, using FlowFile attributes and Environment variables.

This property is only considered if:
  • the property CSV Format has a value of custom
Escape Character *Escape Character\The character that is used to escape characters that would otherwise have a specific meaning to the CSV Parser. If the property has been specified via Expression Language but the expression gets evaluated to an invalid Escape Character at runtime, then it will be skipped and the default Escape Character will be used. Setting it to an empty string means no escape character should be used.

Supports Expression Language, using FlowFile attributes and Environment variables.

This property is only considered if:
  • the property CSV Format has a value of custom
Comment MarkerComment MarkerThe character that is used to denote the start of a comment. Any line that begins with this comment will be ignored.

Supports Expression Language, using FlowFile attributes and Environment variables.

This property is only considered if:
  • the property CSV Format has a value of custom
Null StringNull StringSpecifies a String that, if present as a value in the CSV, should be considered a null field instead of using the literal value.

This property is only considered if:
  • the property CSV Format has a value of custom
Trim Fields *Trim Fieldstrue
  • true
  • false
Whether or not white space should be removed from the beginning and end of fields

This property is only considered if:
  • the property CSV Format has a value of custom
Quote Mode *Quote ModeQuote Minimal
  • Quote All Values
  • Quote Minimal
  • Quote Non-Numeric Values
  • Do Not Quote Values
Specifies how fields should be quoted when they are written

This property is only considered if:
  • the property CSV Format has a value of custom
Record Separator *Record Separator\nSpecifies the characters to use in order to separate CSV Records

This property is only considered if:
  • the property CSV Format has a value of custom
Include Trailing Delimiter *Include Trailing Delimiterfalse
  • true
  • false
If true, a trailing delimiter will be added to each CSV Record that is written. If false, the trailing delimiter will be omitted.

This property is only considered if:
  • the property CSV Format has a value of custom
Character Set *csvutils-character-setUTF-8The Character Encoding that is used to encode/decode the CSV file

State Management

This component does not store state.

Restricted

This component is not restricted.

System Resource Considerations

This component does not specify system resource considerations.

See Also