CreateSnowflakeEmbeddings
Description
Create vector embeddings using Snowflake Cortex Large Language Model functions
Tags
chatbot, embeddings, gen ai, generative ai, llm, nlp, snowflake, text
Properties
In the list below required Properties are shown with an asterisk (*). Other properties are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.
| Display Name | API Name | Default Value | Allowable Values | Description |
|---|---|---|---|---|
| Snowflake Connection Service * | Snowflake Connection Service | Controller Service: DBCPService Implementations: DBCPConnectionPoolLookup DBCPConnectionPool HikariCPConnectionPool SnowflakeConnectionService | Database Connection Service for accessing Snowflake | |
| Dimensions * | Dimensions | 768 |
| The number of dimensions to request the resulting output embeddings have. |
| Embeddings Model * | Embeddings Model | snowflake-arctic-embed-m | The model to use for embeddings | |
| Record Writer * | Record Writer | Controller Service: RecordSetWriterFactory Implementations: AvroRecordSetWriter CSVRecordSetWriter FreeFormTextRecordSetWriter JsonRecordSetWriter RecordSetWriterLookup ScriptedRecordSetWriter XMLRecordSetWriter | The Record Writer to use for writing the output |
Dynamic Properties
This component does not support dynamic properties.
Relationships
| Name | Description |
|---|---|
| failure | The original FlowFile will be routed to this relationship if the embeddings could not be created |
| success | The embeddings will be routed to this relationship |
Reads Attributes
This processor does not read attributes.
Writes Attributes
| Name | Description |
|---|---|
| mime.type | The MIME type of the output data, based on the chosen Record Writer |
| record.count | The number of records written to the output |
State Management
This component does not store state.
Restricted
This component is not restricted.
Input Requirement
Input requirements are not specified for this component.
System Resource Considerations
This component does not specify system resource considerations.