Documentation ¶
Overview ¶
Package token is generated by GoGLL. Do not edit
Index ¶
Constants ¶
This section is empty.
Variables ¶
View Source
var StringToType = map[string]Type{ "Error": Error, "EOF": EOF, "T_0": T_0, "T_1": T_1, }
View Source
var TypeToID = []string{
"Error",
"$",
"+",
"a",
}
View Source
var TypeToString = []string{
"Error",
"EOF",
"T_0",
"T_1",
}
Functions ¶
This section is empty.
Types ¶
type Token ¶
type Token struct {
// contains filtered or unexported fields
}
Token is returned by the lexer for every scanned lexical token
func New ¶
New returns a new token. lext is the left extent and rext the right extent of the token in the input. input is the input slice scanned by the lexer.
func (*Token) GetLineColumn ¶
GetLineColumn returns the line and column of the left extent of t
func (*Token) LiteralString ¶
LiteralString returns string(t.Literal())
Click to show internal directories.
Click to hide internal directories.