prepare

Documentation

Index

• func LowerAndRemovePunctuation(s string) string
• func NormalizeGender(input string) string
• func RemoveCompanyTitles(in string) string
• func RemoveStopwords(in string, countryName string) string
• func ReorderSDNName(name, sdnType string) string
• func ReorderSDNNames(names []string, sdnType string) []string

Functions

func LowerAndRemovePunctuation

func LowerAndRemovePunctuation(s string) string

LowerAndRemovePunctuation will lowercase each substring and remove punctuation

This function is called on every record from the flat files and all search requests (i.e. HTTP and searcher.TopNNNs methods). See: https://godoc.org/golang.org/x/text/unicode/norm#Form See: https://withblue.ink/2019/03/11/why-you-need-to-normalize-unicode-strings.html

func NormalizeGender

func NormalizeGender(input string) string

func RemoveCompanyTitles

func RemoveCompanyTitles(in string) string

func RemoveStopwords

func RemoveStopwords(in string, countryName string) string

func ReorderSDNName

func ReorderSDNName(name, sdnType string) string

ReorderSDNName will take a given SDN name and, if it matches "Surname, FirstName(s)", reorder it to "FirstName(s) Surname" (only for type == "individual").

func ReorderSDNNames

func ReorderSDNNames(names []string, sdnType string) []string