llm_provider

Documentation

Index

• Constants
• type AnthropicLLMProvider
  • func NewAnthropicLLMProvider(apiKey string, model string) *AnthropicLLMProvider
  • func (p *AnthropicLLMProvider) GetCompletion(fullSystemMessage string, messages []Message, ...) error
• type LLMProvider
  • func ResolveFromConfig(conf *config.Config) (LLMProvider, error)
• type Message
• type OpenAILLMProvider
  • func NewOpenAILLMProvider(apiKey string, model string) *OpenAILLMProvider
  • func (p *OpenAILLMProvider) GetCompletion(fullSystemMessage string, messages []Message, ...) error
• type TestLLMProvider
  • func (p *TestLLMProvider) GetCompletion(fullSystemMessage string, messages []Message, ...) error

Constants

const TestProviderExpectedMessage = "Hello, world!"

Types

type AnthropicLLMProvider

type AnthropicLLMProvider struct {
	// contains filtered or unexported fields
}

func NewAnthropicLLMProvider

func NewAnthropicLLMProvider(apiKey string, model string) *AnthropicLLMProvider

func (*AnthropicLLMProvider) GetCompletion

func (p *AnthropicLLMProvider) GetCompletion(
	fullSystemMessage string,
	messages []Message,
	handleTokens func(tokens string) error,
) error

type LLMProvider

type LLMProvider interface {
	// Get a completion from an LLM. The function should pass the system message
	// (already including the context) to the LLM.
	GetCompletion(
		fullSystemMessage string,
		messages []Message,
		handleTokens func(tokens string) error,
	) error
}

A provider should act as a proxy to some LLM provider, such as "openai", "anthropic" or different. Its only task is to implement the GetCompletion function.

func ResolveFromConfig

func ResolveFromConfig(conf *config.Config) (LLMProvider, error)

type Message

type Message struct {
	Role    string
	Content string
}

type OpenAILLMProvider

type OpenAILLMProvider struct {
	// contains filtered or unexported fields
}

func NewOpenAILLMProvider

func NewOpenAILLMProvider(apiKey string, model string) *OpenAILLMProvider

func (*OpenAILLMProvider) GetCompletion

func (p *OpenAILLMProvider) GetCompletion(
	fullSystemMessage string,
	messages []Message,
	handleTokens func(tokens string) error,
) error

type TestLLMProvider

type TestLLMProvider struct{}

func (*TestLLMProvider) GetCompletion

func (p *TestLLMProvider) GetCompletion(
	fullSystemMessage string,
	messages []Message,
	handleTokens func(tokens string) error,
) error