token

Documentation

Index

• type Token
  • func NewToken(value []byte, startLine int, endLine int, startPos int, endPos int) Token
  • func (t Token) Comments() []comment.Comment
  • func (t Token) SetComments(comments []comment.Comment) Token
  • func (t Token) String() string

Types

type Token

type Token struct {
	Value     string
	StartLine int
	EndLine   int
	StartPos  int
	EndPos    int
	// contains filtered or unexported fields
}

Token value returned by lexer

func NewToken

func NewToken(value []byte, startLine int, endLine int, startPos int, endPos int) Token

NewToken Token constructor TODO: return pointer

func (Token) Comments

func (t Token) Comments() []comment.Comment

Comments returns attached comments

func (Token) SetComments

func (t Token) SetComments(comments []comment.Comment) Token

SetComments attach comments

func (Token) String

func (t Token) String() string