README ¶ japanese Japanese tokenizer. Expand ▾ Collapse ▴ Documentation ¶ Index ¶ type Token Constants ¶ This section is empty. Variables ¶ This section is empty. Functions ¶ This section is empty. Types ¶ type Token ¶ type Token struct { Original string Hiragana string Katakana string Romaji string Furigana bool } Token represents a single token in a sentence. Source Files ¶ View all Source files Token.go Directories ¶ Show internal Expand all Path Synopsis client cmd japanese tokenizer Click to show internal directories. Click to hide internal directories.