Versions in this module Expand all Collapse all v0 v0.1.0 Jul 29, 2022 Changes in this version + type EnTokenizer struct + func (s *EnTokenizer) Free() + func (s *EnTokenizer) Seg(text string) []string + type JiebaTokenizer struct + func NewJieba() *JiebaTokenizer + func (j *JiebaTokenizer) Free() + func (j *JiebaTokenizer) Seg(text string) []string + type Tokenizer interface + Free func() + Seg func(text string) []string
Go to main page