lexer

README

lexer

Parser for the ICU project rbnf rule format

The code in the file lexer.go is based on the template lexer of the standard Go distribution:

    https://golang.org/src/text/template/parse/lex.go

References:

• https://golang.org/src/text/template/parse/lex.go
• https://talks.golang.org/2011/lex.slide
• https://www.youtube.com/watch?v=HxaD_trXwRE

Documentation

Index

• type Lexer
  • func Lex(input string) *Lexer
  • func (l *Lexer) Result() []string
  • func (l *Lexer) Run() error

Types

type Lexer

type Lexer struct {
	// contains filtered or unexported fields
}

Lexer is a struct for used to parse an input rbnf string into a slice of items

func Lex

func Lex(input string) *Lexer

Lex creates a new Lexer for the input string

func (*Lexer) Result

func (l *Lexer) Result() []string

Result creates the final result (slice of strings)

func (*Lexer) Run

func (l *Lexer) Run() error

Run is called to parse the input string into separate items