unique

Documentation

Index

• Constants
• func UniqueTermFilterConstructor(config map[string]interface{}, cache *registry.Cache) (analysis.TokenFilter, error)
• type UniqueTermFilter
  • func NewUniqueTermFilter() *UniqueTermFilter
  • func (f *UniqueTermFilter) Filter(input analysis.TokenStream) analysis.TokenStream

Constants

const Name = "unique"

Functions

func UniqueTermFilterConstructor

func UniqueTermFilterConstructor(config map[string]interface{}, cache *registry.Cache) (analysis.TokenFilter, error)

Types

type UniqueTermFilter

type UniqueTermFilter struct{}

UniqueTermFilter retains only the tokens which mark the first occurence of a term. Tokens whose term appears in a preceding token are dropped.

func NewUniqueTermFilter

func NewUniqueTermFilter() *UniqueTermFilter

func (*UniqueTermFilter) Filter

func (f *UniqueTermFilter) Filter(input analysis.TokenStream) analysis.TokenStream