vertex

Documentation

Overview

Package vertex implements the Vertex AI api it is largely similar to the Google "ai studio" provider but uses a different library...

Index

• type VertexAIProvider
  • func NewVertexAIProvider(ctx context.Context, projectID, location string) (*VertexAIProvider, error)
  • func (p *VertexAIProvider) GenerateResponse(ctx context.Context, req llm.InferRequest) (string, error)
  • func (p *VertexAIProvider) GenerateResponseAsync(ctx context.Context, req llm.InferRequest) (<-chan llm.StreamDelta, error)

Types

type VertexAIProvider

type VertexAIProvider struct {
	// contains filtered or unexported fields
}

func NewVertexAIProvider

func NewVertexAIProvider(ctx context.Context, projectID, location string) (*VertexAIProvider, error)

func (*VertexAIProvider) GenerateResponse

func (p *VertexAIProvider) GenerateResponse(ctx context.Context, req llm.InferRequest) (string, error)

func (*VertexAIProvider) GenerateResponseAsync

func (p *VertexAIProvider) GenerateResponseAsync(ctx context.Context, req llm.InferRequest) (<-chan llm.StreamDelta, error)