Documentation ¶
Index ¶
Constants ¶
View Source
const ( // EOF scanner EOF = -(iota + 1) // MaxTokenLen length of a token MaxTokenLen = 1 << 20 // 1 Mega Token )
Variables ¶
View Source
var (
// Whitespace default whitespaces characters taken by scanner
Whitespace = "\t\n\r "
)
Functions ¶
This section is empty.
Types ¶
type Scanner ¶
type Scanner struct { Offset int64 LastOffset int64 Whitespace *datastructs.BitSet Error func(error) // contains filtered or unexported fields }
Scanner structure definition
func (*Scanner) InitWhitespace ¶
InitWhitespace initialised an new set of whitespaces for the scanner
Click to show internal directories.
Click to hide internal directories.