Documentation ¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
Types ¶
type TokenKind ¶
type TokenKind int
TokenKind tells what kind of value is in the Token
const ( // BadToken is bad.. too bad.. BadToken TokenKind = iota // PunctuatorToken has special characters PunctuatorToken // ! $ ( ) ... : = @ [ ] { | } // NameToken has names NameToken // /[_A-Za-z][_0-9A-Za-z]*/ // IntValueToken has iteger numbers IntValueToken // NegativeSign(opt) | NonZeroDigit | Digit (list, opt) // FloatValueToken has float numbers FloatValueToken // Sign (opt) | IntegerPart | FractionalPart (ExponentPart) // StringValueToken has string values StringValueToken // "something which is a string" // UnicodeBOMToken is just the \ufeff UnicodeBOMToken // \ufeff // WhitespaceToken is \t and 'space' WhitespaceToken // \t and 'space' // LineTerminatorToken is \n and \r LineTerminatorToken // \n // CommentToken is # something like this CommentToken // # Just a comment.... // CommaToken is just a ',' CommaToken // , )
Click to show internal directories.
Click to hide internal directories.