Class OpenAiCompatibleChatCompletionClient

java.lang.Object

ch.tocco.nice2.optional.aiassistant.impl.function.manual.OpenAiCompatibleChatCompletionClient

All Implemented Interfaces:

ChatCompletionClient

@Component
public class OpenAiCompatibleChatCompletionClient
extends Object
implements ChatCompletionClient

ChatCompletionClient backed by an OpenAI-compatible /chat/completions endpoint, configured via ManualParameterProvider. Tool calls are executed locally and their results sent back to the LLM, for at most MAX_TOOL_ROUNDS rounds; then the LLM must answer.

Nested Class Summary

Nested classes/interfaces inherited from interface ChatCompletionClient

ChatCompletionClient.Turn

Constructor Summary

Constructors

Constructor	Description
OpenAiCompatibleChatCompletionClient(ManualParameterProvider parameterProvider)

Method Summary

Modifier and Type	Method	Description
@Nullable String	complete(String systemPrompt, List<ChatCompletionClient.Turn> conversation)
@Nullable String	complete(String systemPrompt, List<ChatCompletionClient.Turn> conversation, TextResourceSearchTool tool)	Same as ChatCompletionClient.complete(String, List), but the LLM has to call the tool before it answers.

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

OpenAiCompatibleChatCompletionClient

public OpenAiCompatibleChatCompletionClient(ManualParameterProvider parameterProvider)

Method Details

complete

public @Nullable String complete(String systemPrompt,
 List<ChatCompletionClient.Turn> conversation)

Specified by:

complete in interface ChatCompletionClient

Parameters:

systemPrompt - instructions for the assistant (grounding, citation, language)

conversation - ordered turns, each authored by the Role.USER or Role.ASSISTANT

Returns:

the assistant's answer text, or null if the provider returned no content

complete

public @Nullable String complete(String systemPrompt,
 List<ChatCompletionClient.Turn> conversation,
 TextResourceSearchTool tool)

Description copied from interface: ChatCompletionClient

Same as ChatCompletionClient.complete(String, List), but the LLM has to call the tool before it answers.

Specified by:

complete in interface ChatCompletionClient