token

Documentation

Index

• func MessageTokenCount(messages []openai.ChatCompletionMessage, model string) (numTokens int, err error)

Functions

func MessageTokenCount

func MessageTokenCount(messages []openai.ChatCompletionMessage, model string) (numTokens int, err error)

MessageTokenCount Count the number of tokens in the session context TODO Token calculation methods that are not based on the vendor model may be different, and need to be differentiated according to the vendor model