Versions in this module Expand all Collapse all v0 v0.0.1 Jun 27, 2023 Changes in this version + type OfflineLoader struct + func NewOfflineLoader() *OfflineLoader + func (l *OfflineLoader) LoadTiktokenBpe(tiktokenBpeFile string) (map[string]int, error)
Go to main page