ernie

package
v1.0.12 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Sep 1, 2024 License: MIT Imports: 7 Imported by: 3

Documentation

Overview

Package ernie wrapper around the Baidu Large Language Model Platform APIs. ERNIE-Bot is a Baidu-developed large language model. Additional information can be found at: https://cloud.baidu.com/doc/WENXINWORKSHOP/index.html .

Index

Constants

View Source
const (
	ModelNameERNIEBot       = "ERNIE-Bot"
	ModelNameERNIEBotTurbo  = "ERNIE-Bot-turbo"
	ModelNameERNIEBotPro    = "ERNIE-Bot-pro"
	ModelNameBloomz7B       = "BLOOMZ-7B"
	ModelNameLlama2_7BChat  = "Llama-2-7b-chat"
	ModelNameLlama2_13BChat = "Llama-2-13b-chat"
	ModelNameLlama2_70BChat = "Llama-2-70b-chat"
)

Variables

View Source
var (
	ErrEmptyResponse = errors.New("no response")
	ErrCodeResponse  = errors.New("has error code")
)

Functions

This section is empty.

Types

type LLM

type LLM struct {
	CallbacksHandler callbacks.Handler
	// contains filtered or unexported fields
}

func New

func New(opts ...Option) (*LLM, error)

New returns a new Anthropic LLM.

func (*LLM) Call

func (o *LLM) Call(ctx context.Context, prompt string, options ...llms.CallOption) (string, error)

func (*LLM) CreateEmbedding

func (o *LLM) CreateEmbedding(ctx context.Context, texts []string) ([][]float32, error)

CreateEmbedding use ernie Embedding-V1. 1. texts counts less than 16 2. text runes counts less than 384 doc: https://cloud.baidu.com/doc/WENXINWORKSHOP/s/alj562vvu

func (*LLM) GenerateContent

func (o *LLM) GenerateContent(ctx context.Context, messages []llms.MessageContent, options ...llms.CallOption) (*llms.ContentResponse, error)

GenerateContent implements the Model interface.

type ModelName

type ModelName string

type Option

type Option func(*options)

func WithAKSK

func WithAKSK(apiKey, secretKey string) Option

WithAKSK passes the ERNIE API Key and Secret Key to the client. If not set, the keys are read from the ERNIE_API_KEY and ERNIE_SECRET_KEY environment variable. eg:

export ERNIE_API_KEY={Api Key}
export ERNIE_SECRET_KEY={Serect Key}

Api Key,Serect Key from https://console.bce.baidu.com/qianfan/ais/console/applicationConsole/application More information available: https://cloud.baidu.com/doc/WENXINWORKSHOP/s/flfmc9do2

func WithAccessToken

func WithAccessToken(accessToken string) Option

WithAccessToken usually used for dev, Prod env recommend use WithAKSK.

func WithCallbackHandler

func WithCallbackHandler(callbacksHandler callbacks.Handler) Option

WithCallbackHandler passes the callback Handler to the client.

func WithModelName

func WithModelName(modelName ModelName) Option

WithModelName passes the Model Name to the client. If not set, use default ERNIE-Bot.

Directories

Path Synopsis
internal

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL