Versions in this module Expand all Collapse all v0 v0.1.15 Oct 30, 2024 v0.1.14 Oct 30, 2024 Changes in this version + type Backend interface + Get func(ctx context.Context, key string) *llms.ContentResponse + Put func(ctx context.Context, key string, response *llms.ContentResponse) + type Cacher struct + func New(llm llms.Model, backend Backend) *Cacher + func (c *Cacher) Call(ctx context.Context, prompt string, options ...llms.CallOption) (string, error) + func (c *Cacher) GenerateContent(ctx context.Context, messages []llms.MessageContent, ...) (*llms.ContentResponse, error)
Go to main page