tiktoken

package
v0.3.0 Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Jun 9, 2024 License: MIT Imports: 2 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func EncodingForModel added in v0.1.3 

func EncodingForModel(model string) (*tiktoken.Tiktoken, error)

func NumTokensFromMessages 

func NumTokensFromMessages(model string, messages []model.ChatCompletionMessage) (numTokens int, err error)

func NumTokensFromString 

func NumTokensFromString(model, text string) (int, error)

Types

This section is empty.

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.