Package com.vaadin.flow.component.ai.provider

Class SpringAiLLMProvider

java.lang.Object
com.vaadin.flow.component.ai.provider.SpringAiLLMProvider
All Implemented Interfaces:
LLMProvider
public class SpringAiLLMProvider extends Object implements LLMProvider
Spring AI implementation of LLMProvider.

Supports both streaming and non-streaming Spring AI models. Tool calling is supported through Spring AI's Tool annotation.

Each provider instance maintains its own chat memory. To share conversation history across components, reuse the same provider instance.

Note: SpringAiLLMProvider is not serializable. If your application uses session persistence, you will need to create a new provider instance after session restore.

Author:
Vaadin Ltd

  • Constructor Details

    • SpringAiLLMProvider

      public SpringAiLLMProvider(org.springframework.ai.chat.model.ChatModel chatModel)
      Constructor with a chat model.
      Parameters:
      chatModel - the chat model, not null
      Throws:
      NullPointerException - if chatModel is null

    • SpringAiLLMProvider

      public SpringAiLLMProvider(org.springframework.ai.chat.client.ChatClient chatClient)
      Constructor with a chat client. Note: When using this constructor, conversation memory must be configured externally in the ChatClient.
      Parameters:
      chatClient - the chat client, not null
      Throws:
      NullPointerException - if chatModel is null

  • Method Details

    • stream

      public reactor.core.publisher.Flux<String> stream(LLMProvider.LLMRequest request)
      Description copied from interface: LLMProvider
      Streams a response from the LLM based on the provided request. This method returns a reactive stream that emits response tokens as they become available from the LLM. The provider manages conversation history internally, so each call to this method adds to the ongoing conversation context.
      Specified by:
      stream in interface LLMProvider
      Parameters:
      request - the LLM request containing user message, system prompt, attachments, and tools, not null
      Returns:
      a Flux stream that emits response tokens as strings, never null

    • setStreaming

      public void setStreaming(boolean streaming)
      Sets whether to use streaming mode. The default is true.
      Parameters:
      streaming - true to use streaming mode, false for non-streaming.