Documentation ¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type JiebaTokenizer ¶
type JiebaTokenizer struct {
// contains filtered or unexported fields
}
JiebaTokenizer ..
func (*JiebaTokenizer) Tokenize ¶
func (s *JiebaTokenizer) Tokenize(sentence []byte) analysis.TokenStream
Tokenize ..
Click to show internal directories.
Click to hide internal directories.