nlp_detect

README

Detect the language of text.

Supported languages

Supports 175 “languages”. For a complete list, check out languages list

Usage

response := lygo_nlpdetect.DetectOne("Votre temps est limité, ne le gâchez pas en menant une existence qui n’est pas la vôtre.")
// response == {Code:"fra" Count:1}

response := nlp_detect.Detect("Votre temps est limité, ne le gâchez pas en menant une existence qui n’est pas la vôtre.")
// response == [{Code:"fra" Count:1},{spa 0.7709821779068855},{cat 0.7656434011148622},{src 0.7274083379131664}...]

Documentation

Index

• Constants
• Variables
• type LanguageDetector
  • func NewLanguageDetector() (instance *LanguageDetector)
  • func (instance *LanguageDetector) Detect(value string) Tuples
  • func (instance *LanguageDetector) DetectOne(value string) Tuple
  • func (instance *LanguageDetector) DetectOneWithFilters(value string, whitelist []string, blacklist []string) Tuple
  • func (instance *LanguageDetector) DetectWithFilters(value string, whitelist, blacklist []string) Tuples
  • func (instance *LanguageDetector) GetLanguageISO(value string) *LanguageISO
  • func (instance *LanguageDetector) GetLanguageISOName(value string) string
• type LanguageISO
• type String
  • func NewString(contents string) *String
  • func (s *String) At(i int) rune
  • func (s *String) Init(contents string) *String
  • func (s *String) IsASCII() bool
  • func (s *String) RuneCount() int
  • func (s *String) Slice(i, j int) string
  • func (s *String) String() string
• type Tuple
• type Tuples
  • func (t Tuples) Len() int
  • func (t Tuples) Less(i, j int) bool
  • func (t Tuples) Swap(i, j int)

Constants

const MAX_DIFFERENCE = float64(300)

const MAX_LENGTH = 2048

const MIN_LENGTH = 3

Variables

var EXPRESSION_DATA string

var NAMES_DATA string

var SCRIPT_DATA string

Types

type LanguageDetector

type LanguageDetector struct {
	// contains filtered or unexported fields
}

func NewLanguageDetector

func NewLanguageDetector() (instance *LanguageDetector)

func (*LanguageDetector) Detect

func (instance *LanguageDetector) Detect(value string) Tuples

Detect Get a list of probable languages the given value is written in.

func (*LanguageDetector) DetectOne

func (instance *LanguageDetector) DetectOne(value string) Tuple

DetectOne Get the most probable language for the given value.

func (*LanguageDetector) DetectOneWithFilters

func (instance *LanguageDetector) DetectOneWithFilters(value string, whitelist []string, blacklist []string) Tuple

DetectOneWithFilters Get the most probable language for the given value.

func (*LanguageDetector) DetectWithFilters

func (instance *LanguageDetector) DetectWithFilters(value string, whitelist, blacklist []string) Tuples

DetectWithFilters Get a list of probable languages the given value is written in.

func (*LanguageDetector) GetLanguageISO

func (instance *LanguageDetector) GetLanguageISO(value string) *LanguageISO

func (*LanguageDetector) GetLanguageISOName

func (instance *LanguageDetector) GetLanguageISOName(value string) string

type LanguageISO

type LanguageISO struct {
	Code1   string `json:"code-1"`
	Code2   string `json:"code-2"`
	Name    string `json:"name"`
	WikiUrl string `json:"wiki-url"`
}

type String

type String struct {
	// contains filtered or unexported fields
}

String wraps a regular string with a small structure that provides more efficient indexing by code point index, as opposed to byte index. Scanning incrementally forwards or backwards is O(1) per index operation (although not as fast a range clause going forwards). Random access is O(N) in the length of the string, but the overhead is less than always scanning from the beginning. If the string is ASCII, random access is O(1). Unlike the built-in string type, String has internal mutable state and is not thread-safe.

func NewString

func NewString(contents string) *String

NewString returns a new UTF-8 string with the provided contents.

func (*String) At

func (s *String) At(i int) rune

At returns the rune with index i in the String. The sequence of runes is the same as iterating over the contents with a "for range" clause.

func (*String) Init

func (s *String) Init(contents string) *String

Init initializes an existing String to hold the provided contents. It returns a pointer to the initialized String.

func (*String) IsASCII

func (s *String) IsASCII() bool

IsASCII returns a boolean indicating whether the String contains only ASCII bytes.

func (*String) RuneCount

func (s *String) RuneCount() int

RuneCount returns the number of runes (Unicode code points) in the String.

func (*String) Slice

func (s *String) Slice(i, j int) string

Slice returns the string sliced at rune positions [i:j].

func (*String) String

func (s *String) String() string

String returns the contents of the String. This method also means the String is directly printable by fmt.Print.

type Tuple

type Tuple struct {
	Code  string
	Count float64
}

type Tuples

type Tuples []Tuple

func (Tuples) Len

func (t Tuples) Len() int

func (Tuples) Less

func (t Tuples) Less(i, j int) bool

func (Tuples) Swap

func (t Tuples) Swap(i, j int)