lexer

Documentation

Overview

Package lexer implements lexer for a simple regular expression.

Index

• type Lexer
  • func NewLexer(s string) *Lexer
  • func (l *Lexer) Scan() (tokenList []token.Token)

Types

type Lexer

type Lexer struct {
	// contains filtered or unexported fields
}

Lexer has a slice of symbols to analyze.

func NewLexer

func NewLexer(s string) *Lexer

NewLexer returns a new Lexer. This constructor create a sequence of symbols from the string given in the argument and hold it.

func (*Lexer) Scan

func (l *Lexer) Scan() (tokenList []token.Token)

Scan returns the token list to which converted from the symbol slice held in Lexer struct.