lexer

Documentation

Index

• type Lexer
  • func NewLexer(input string) (l *Lexer)
  • func (l *Lexer) GetColumnPosition() int
  • func (l *Lexer) GetLinePosition() int
  • func (l *Lexer) NextToken() (tok token.Token)

Types

type Lexer

type Lexer struct {
	// contains filtered or unexported fields
}

Lexer - represents a lexical analyzer for the input source code.

func NewLexer

func NewLexer(input string) (l *Lexer)

NewLexer - creates a new Lexer instance with the given input source code.

func (*Lexer) GetColumnPosition

func (l *Lexer) GetColumnPosition() int

GetColumnPosition - returns the current column position of the Lexer in the input source code.

func (*Lexer) GetLinePosition

func (l *Lexer) GetLinePosition() int

GetLinePosition - returns the current line position of the Lexer in the input source code.

func (*Lexer) NextToken

func (l *Lexer) NextToken() (tok token.Token)

NextToken returns the next token from the input string