PromptOllama
Description
Sends a prompt to Ollama, writing the response either as a FlowFile attribute or to the contents of the incoming FlowFile. The prompt may consist of pure text interaction or may include images. In the case of images the contents of the FlowFile will be used. Since the Web Client Service will also be used to download models the Timeouts should be set high to allow for large model downloads.
Tags
ai, chat, image, ollama, prompt, text
Properties
In the list below required Properties are shown with an asterisk (*). Other properties are considered optional. The table also indicates any default values, and whether a property supports the NiFi Expression Language.
| Display Name | API Name | Default Value | Allowable Values | Description |
|---|---|---|---|---|
| Service URL * | Service URL | The URL to use to communicate with Ollama | ||
| Web Client Service * | Web Client Service | Controller Service: WebClientServiceProvider Implementations: StandardWebClientServiceProvider | The Web Client Service to use for communicating with Ollama. Set timeouts greater than 5 mins for model downloads. | |
| Prompt Type * | Prompt Type | Text |
| The type of prompt to send to Ollama |
| Text Model Name * | Text Model Name | llama3.1:8b | The name of the Ollama model for text Supports Expression Language, using FlowFile attributes and Environment variables. This property is only considered if:
| |
| Image Model Name * | Image Model Name | llava:7b | The name of the Ollama model for images Supports Expression Language, using FlowFile attributes and Environment variables. This property is only considered if:
| |
| System Message | System Message | The system message to send to Ollama. FlowFile attributes may be referenced via Expression Language, and the contents of the FlowFile may be referenced via the flowfile_content variable. E.g., ${flowfile_content} Supports Expression Language, using FlowFile attributes and Environment variables. | ||
| User Message * | User Message | The user message to send to Ollama. FlowFile attributes may be referenced via Expression Language, and the contents of the FlowFile may be referenced via the flowfile_content variable. E.g., ${flowfile_content} Supports Expression Language, using FlowFile attributes and Environment variables. | ||
| Response Format * | Response Format | Plain Text |
| The format of the response from Ollama |
| Output Strategy * | Output Strategy | FlowFile |
| Determines response output destination |
| Results Attribute | Results Attribute | The name of the attribute to write the response to. This property is only considered if:
| ||
| Max File Size | Max File Size | 10 MB | The maximum size of a FlowFile that can be sent to Ollama as an image. If the FlowFile is larger than this, it will be routed to 'failure'. This property is only considered if:
| |
| Temperature | Temperature | The temperature to use for generating the response. Supports Expression Language, using FlowFile attributes and Environment variables. | ||
| Top P | Top P | The top P value to use for generating the response Supports Expression Language, using FlowFile attributes and Environment variables. | ||
| Seed | Seed | The seed to use for generating the response Supports Expression Language, using FlowFile attributes and Environment variables. |
Dynamic Properties
This component does not support dynamic properties.
Relationships
| Name | Description |
|---|---|
| failure | If unable to obtain a valid response from Ollama, the original FlowFile will be routed to this relationship |
| success | The response from Ollama is routed to this relationship |
Reads Attributes
This processor does not read attributes.
Writes Attributes
This processor does not write attributes.
State Management
This component does not store state.
Restricted
This component is not restricted.
Input Requirement
This component requires an incoming relationship.
System Resource Considerations
This component does not specify system resource considerations.