utils

Documentation

Overview

Package utils provides some utility functions for gptchat

Index

• func CalculateTokens(model, content string) int
• func TrimByTokens(model, content string, nTokens int) string

Functions

func CalculateTokens

func CalculateTokens(model, content string) int

CalculateTokens calculate tokens for given model and content

func TrimByTokens

func TrimByTokens(model, content string, nTokens int) string

TrimByTokens trim content by tokens

find the index to split the content by bi-search