lexer

Documentation

Index

• type Lexer
  • func New(input string) *Lexer
  • func (l *Lexer) NextToken() (tok token.Token, literal string)
  • func (l *Lexer) Pos() scanner.Position

Types

type Lexer

type Lexer struct {
	// contains filtered or unexported fields
}

Lexer represents a lexical scanner for Lox programing language.

func New

func New(input string) *Lexer

New return an instance of Lexer.

func (*Lexer) NextToken

func (l *Lexer) NextToken() (tok token.Token, literal string)

NextToken reads and returns token and literal. It returns token.Illegal for invalid string or number. It return token.EOF at the end of input string.

func (*Lexer) Pos

func (l *Lexer) Pos() scanner.Position

Pos returns current position of lexer.