lexer

Documentation

Index

• type Directive
  • func ParseDirective(l *Lexer) *Directive
• type Lexer
  • func NewLexer(input io.Reader) Lexer
  • func (l *Lexer) Next() bool
  • func (l *Lexer) NextLine() bool
  • func (l *Lexer) NextVal() string
  • func (l *Lexer) Val() string
• type Token

Types

type Directive

type Directive struct {
	Name       string
	Args       []string
	Directives []*Directive
}

func ParseDirective

func ParseDirective(l *Lexer) *Directive

type Lexer

type Lexer struct {
	// contains filtered or unexported fields
}

Lexer gets values, token by token, from an io.Reader.

func NewLexer

func NewLexer(input io.Reader) Lexer

Loads an io.Reader and wraps it into a bufio.Reader to prepare the Lexer for scanning tokens.

func (*Lexer) Next

func (l *Lexer) Next() bool

Loads a token only if on the same line. Returns true if a token is found, false otherwise.

func (*Lexer) NextLine

func (l *Lexer) NextLine() bool

Loads the first token of the next line. Returns true if a token is found, false otherwise.

func (*Lexer) NextVal

func (l *Lexer) NextVal() string

Returns the next token value.

func (*Lexer) Val

func (l *Lexer) Val() string

Returns the current token value.

type Token

type Token struct {
	Val  string
	Line uint
}

Token stores a value, and metadata associated to it.