tokenize

Documentation

Index

• Constants
• type Token
  • func Tokenize(path string) ([]Token, error)

Constants

const TokenTypeKey = "tokenTypeKey"

TODO: make these their own type

const TokenTypeSlice = "tokenTypeSlice"

Types

type Token

type Token struct {
	Text string
	Type string
}

func Tokenize

func Tokenize(path string) ([]Token, error)

Tokenize a configpath into a list of tokens