tokenizers

package
v1.1.0 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jan 12, 2023 License: MIT Imports: 5 Imported by: 0

Documentation

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

This section is empty.

Types

type MustacheSpecialState

type MustacheSpecialState struct {
}

Implements a quote string state object for Mustache templates.

func NewMustacheSpecialState

func NewMustacheSpecialState() *MustacheSpecialState

func (*MustacheSpecialState) NextToken

func (c *MustacheSpecialState) NextToken(scanner io.IScanner,
	tokenizer tokenizers.ITokenizer) *tokenizers.Token

Gets the next token from the stream started from the character linked to this state.

Parameters:

  • scanner: A textual string to be tokenized.
  • tokenizer: A tokenizer class that controls the process.

Returns: The next token from the top of the stream.

type MustacheTokenizer

type MustacheTokenizer struct {
	tokenizers.AbstractTokenizer
	// contains filtered or unexported fields
}

func NewMustacheTokenizer

func NewMustacheTokenizer() *MustacheTokenizer

func (*MustacheTokenizer) ReadNextToken

func (c *MustacheTokenizer) ReadNextToken() *tokenizers.Token

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL