tokenmap

Documentation

Overview

package token_map implements a generic TokenMap, often used in conjunction with filters to remove or process specific tokens.

Its constructor takes the following arguments:

"filename" (string): the path of a file listing the tokens. Each line may contain one or more whitespace separated tokens, followed by an optional comment starting with a "#" or "|" character.

"tokens" ([]interface{}): if "filename" is not specified, tokens can be passed directly as a sequence of strings wrapped in a []interface{}.

Index

• Constants
• func GenericTokenMapConstructor(config map[string]interface{}, cache *registry.Cache) (analysis.TokenMap, error)

Constants

const Name = "custom"

Functions

func GenericTokenMapConstructor

func GenericTokenMapConstructor(config map[string]interface{}, cache *registry.Cache) (analysis.TokenMap, error)