dictionary

Documentation

Overview

Package dictionary contains a interface and wraps all io related work. It is used by jiebago module to read/write files.

Index

• func LoadDictionary(dl DictLoader, fileName string) error
• func LoadDictionaryRemote(dl DictLoader, url string) (err error)
• type DictLoader
• type Token
  • func NewToken(text string, frequency float64, pos string) Token
  • func (t Token) Frequency() float64
  • func (t Token) Pos() string
  • func (t Token) Text() string

Functions

func LoadDictionary

func LoadDictionary(dl DictLoader, fileName string) error

LoadDictionary reads the given file and passes all tokens to a DictLoader.

func LoadDictionaryRemote

func LoadDictionaryRemote(dl DictLoader, url string) (err error)

Types

type DictLoader

type DictLoader interface {
	Load(<-chan Token)
	AddToken(Token)
}

DictLoader is the interface that could add one token or load tokens from channel.

type Token

type Token struct {
	// contains filtered or unexported fields
}

Token represents a Chinese word with (optional) frequency and POS.

func NewToken

func NewToken(text string, frequency float64, pos string) Token

NewToken creates a new token.

func (Token) Frequency

func (t Token) Frequency() float64

Frequency returns token's frequency.

func (Token) Pos

func (t Token) Pos() string

Pos returns token's POS.

func (Token) Text

func (t Token) Text() string

Text returns token's text.