tokenizer

package
v1.0.831 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jan 29, 2025 License: Apache-2.0 Imports: 5 Imported by: 1

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func Tokenize

func Tokenize(data any) string

func TokenizedHash

func TokenizedHash(data any) string

Types

type Replacement

type Replacement struct {
	Value string
	Regex *regexp.Regexp
}

type Replacements

type Replacements []Replacement

func NewReplacements

func NewReplacements(pairs ...string) Replacements

func (Replacements) Tokenize

func (replacements Replacements) Tokenize(data any) string

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL