Versions in this module Expand all Collapse all v2 v2.4.3 Mar 29, 2024 v2.4.2 Mar 29, 2024 Changes in this version + const Name + func TokenizerConstructor(config map[string]interface{}, cache *registry.Cache) (analysis.Tokenizer, error)