util

Documentation

Overview

Package util is where we place all utility funcs that can be used in every other packages

Index

• func CreateWordSet(words []string) map[string]int
• func GetEnv(env string) string
• func SliceStringToInt64(ss []string) []int64
• func StringToInt64(s string) int64
• func Tokenize(s string, isUsingStopwordRemoval bool, stopwordSet map[string]int) map[string]int
• func WordsSetIntersection(ma, mb map[string]int) map[string]int
• func WordsSetSubtraction(ma, mb map[string]int) map[string]int
• func WordsSetUnion(ma, mb map[string]int) map[string]int

Functions

func CreateWordSet

func CreateWordSet(words []string) map[string]int

CreateWordSet create a set of words from a slice of string

func GetEnv

func GetEnv(env string) string

GetEnv gets environment from given string

func SliceStringToInt64

func SliceStringToInt64(ss []string) []int64

SliceStringToInt64 converts a slice of string into a slice of int64

func StringToInt64

func StringToInt64(s string) int64

StringToInt64 convert a string into int64

func Tokenize

func Tokenize(s string, isUsingStopwordRemoval bool, stopwordSet map[string]int) map[string]int

tokenize is a tokenizer function, basically to remove punctuations and (optional) to remove stopwords to a document name or a search term

func WordsSetIntersection

func WordsSetIntersection(ma, mb map[string]int) map[string]int

WordsSetIntersection find the intersection between two sets (ma & mb)

func WordsSetSubtraction

func WordsSetSubtraction(ma, mb map[string]int) map[string]int

WordsSetSubtraction do a substraction between two sets ma - mb

func WordsSetUnion

func WordsSetUnion(ma, mb map[string]int) map[string]int

WordsSetUnion do a union from two given words sets