token

Documentation

Index

• Constants
• type Token
• type Type

Constants

const (
	Illegal = "illegal"
	EOF     = "EOF"

	LeftCurly    = "{"
	RightCurly   = "}"
	LeftSquare   = "["
	RightSquare  = "]"
	Comma        = ","
	SingleQuote  = "'"
	Colon        = ":"
	AlphaNumeric = "alphanum"
)

Types of tokens.

Types

type Token

type Token struct {
	Type    Type
	Literal string
}

Token is a lexed token.

type Type

type Type string

Type describes the type of token.