Versions in this module Expand all Collapse all v0 v0.1.1 Feb 17, 2023 Changes in this version + type Encoder struct + func NewEncoder() (*Encoder, error) + func NewEncoderWithVocab(bpeData []byte, jsonEncoder []byte) (*Encoder, error) + func (e *Encoder) Decode(tokens []int) string + func (e *Encoder) Encode(text string) ([]int, error)