lexer

Documentation

Index

• type Item
  • func (i Item) String() string
• type ItemType
• type Lexer
  • func Lex(name, input string) *Lexer
  • func (l *Lexer) NextItem() Item

Types

type Item

type Item struct {
	Typ ItemType // Type, such as itemNumber.
	Val string   // Value, such as "23.2".
}

item represents a token returned from the scanner.

func (Item) String

func (i Item) String() string

type ItemType

type ItemType int

itemType identifies the type of lex items.

const (
	ItemError ItemType = iota // error occurred;
	// value is text of error
	ItemEOF
	ItemAccessor // access field
	ItemIndex    // index of list
	ItemSentinel // something like base64 decode
)

type Lexer

type Lexer struct {
	// contains filtered or unexported fields
}

lexer holds the state of the scanner.

func Lex

func Lex(name, input string) *Lexer

lex creates a new scanner for the input string.

func (*Lexer) NextItem

func (l *Lexer) NextItem() Item

NextItem returns the next item from the input.