Generators

Generators are responsible for generating text after you give them a prompt. They are specific for each LLM technology (OpenAI, local, TGI and others).

Generator	Description	Streaming Support
AmazonBedrockChatGenerator	Enables chat completion using models through Amazon Bedrock service.	✅
AmazonBedrockGenerator	Enables text generation using models through Amazon Bedrock service.	✅
AnthropicChatGenerator	This component enables chat completions using Anthropic large language models (LLMs).	✅
AnthropicVertexChatGenerator	This component enables chat completions using AnthropicVertex API.	✅
AnthropicGenerator	This component enables text completions using Anthropic large language models (LLMs).	✅
AzureOpenAIChatGenerator	Enables chat completion using OpenAI’s LLMs through Azure services.	✅
AzureOpenAIGenerator	Enables text generation using OpenAI’s LLMs through Azure services.	✅
CohereChatGenerator	Enables chat completion using Cohere's LLMs.	✅
CohereGenerator	Queries the LLM using Cohere API.	✅
DALLEImageGenerator	Generate images using OpenAI's DALL-E model.	❌
FallbackChatGenerator	A ChatGenerator wrapper that tries multiple Chat Generators sequentially until one succeeds.	✅
GoogleAIGeminiChatGenerator	Enables chat completion using Google Gemini models. This integration will be deprecated soon. We recommend using GoogleGenAIChatGenerator integration instead.	✅
GoogleAIGeminiGenerator	Enables text generation using Google Gemini models. This integration will be deprecated soon. We recommend using GoogleGenAIChatGenerator integration instead.	✅
GoogleGenAIChatGenerator	Enables chat completion using Google Gemini models through Google Gen AI SDK.	✅
HuggingFaceAPIChatGenerator	Enables chat completion using various Hugging Face APIs.	✅
HuggingFaceAPIGenerator	Enables text generation using various Hugging Face APIs.	✅
HuggingFaceLocalChatGenerator	Provides an interface for chat completion using a Hugging Face model that runs locally.	✅
HuggingFaceLocalGenerator	Provides an interface to generate text using a Hugging Face model that runs locally.	✅
LlamaCppChatGenerator	Enables chat completion using an LLM running on Llama.cpp.	❌
LlamaCppGenerator	Generate text using an LLM running with Llama.cpp.	❌
LlamaStackChatGenerator	Enables chat completions using an LLM model made available via Llama Stack server	✅
MetaLlamaChatGenerator	Enables chat completion with any model hosted available with Meta Llama API.	✅
MistralChatGenerator	Enables chat completion using Mistral’s text generation models.	✅
NvidiaChatGenerator	Enables chat completion using Nvidia-hosted models.	✅
NvidiaGenerator	Provides an interface for generating text using LLMs self-hosted with NVIDIA NIM or models hosted on the NVIDIA API catalog.	❌
OllamaChatGenerator	Enables chat completion using an LLM running on Ollama.	✅
OllamaGenerator	Provides an interface to generate text using an LLM running on Ollama.	✅
OpenAIChatGenerator	Enables chat completion using OpenAI’s large language models (LLMs).	✅
OpenAIGenerator	Enables text generation using OpenAI's large language models (LLMs).	✅
OpenRouterChatGenerator	Enables chat completion with any model hosted on OpenRouter.	✅
SagemakerGenerator	Enables text generation using LLMs deployed on Amazon Sagemaker.	❌
STACKITChatGenerator	Enables chat completions using the STACKIT API.	✅
VertexAICodeGenerator	Enables code generation using Google Vertex AI generative model.	❌
VertexAIGeminiChatGenerator	Enables chat completion using Google Gemini models with GCP Vertex AI. This integration will be deprecated soon. We recommend using GoogleGenAIChatGenerator integration instead.	✅
VertexAIGeminiGenerator	Enables text generation using Google Gemini models with GCP Vertex AI. This integration will be deprecated soon. We recommend using GoogleGenAIChatGenerator integration instead.	✅
VertexAIImageCaptioner	Enables text generation using Google Vertex AI imagetext generative model.	❌
VertexAIImageGenerator	Enables image generation using Google Vertex AI generative model.	❌
VertexAIImageQA	Enables text generation (image captioning) using Google Vertex AI generative models.	❌
VertexAITextGenerator	Enables text generation using Google Vertex AI generative models.	❌
WatsonxGenerator	Enables text generation with IBM Watsonx models.	✅
WatsonxChatGenerator	Enables chat completions with IBM Watsonx models.	✅