token

Documentation

Overview

Package token contains constants which are used when lexing a program written in the monkey language, as done by the parser.

Index

• type Token
  • func (tk Token) String() string

Types

type Token

type Token struct {
	Type    tokentype.TokenType
	Literal string

	Line int // token pos line in source code
	Pos  int // token pos of source code
}

Token struct represent the lexer token

func (Token) String

func (tk Token) String() string