vertexai

Documentation

Overview

Package vertexai is used to provide the vertexai service

Index

• type Provider
  • func NewProvider(projectID, location, model, credentialsFile string) *Provider
  • func (p *Provider) GetChatCompletions(ctx context.Context, req openai.ChatCompletionRequest, md metadata.M) (openai.ChatCompletionResponse, error)
  • func (p *Provider) GetChatCompletionsStream(ctx context.Context, req openai.ChatCompletionRequest, md metadata.M) (provider.ResponseRecver, error)
  • func (p *Provider) Name() string

Types

type Provider

type Provider struct {
	// contains filtered or unexported fields
}

Provider is the provider for google vertexai.

func NewProvider

func NewProvider(projectID, location, model, credentialsFile string) *Provider

NewProvider creates a new vertexai provider.

func (*Provider) GetChatCompletions

func (p *Provider) GetChatCompletions(ctx context.Context, req openai.ChatCompletionRequest, md metadata.M) (openai.ChatCompletionResponse, error)

GetChatCompletions implements provider.LLMProvider.

func (*Provider) GetChatCompletionsStream

func (p *Provider) GetChatCompletionsStream(ctx context.Context, req openai.ChatCompletionRequest, md metadata.M) (provider.ResponseRecver, error)

GetChatCompletionsStream implements provider.LLMProvider.

func (*Provider) Name

func (p *Provider) Name() string

Name implements provider.LLMProvider.