Documentation ¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type KagomeTokenizer ¶
KagomeTokenizer tokenize by kagome.
func NewKagomeTokenizer ¶
func NewKagomeTokenizer(f norm.Form) (*KagomeTokenizer, error)
NewKagomeTokenizer generates new KagomeTokenizer.
func (*KagomeTokenizer) Tokenize ¶
func (kt *KagomeTokenizer) Tokenize(sentence string) [][]byte
Tokenize implements shamoji.Tokenizer interface.
Click to show internal directories.
Click to hide internal directories.