token

package

v0.0.0-...-5a292ea Latest Latest Go to latest Published: Sep 26, 2024 License: MIT Imports: 1 Imported by: 0

Details

Valid go.mod file
Redistributable license
Tagged version
Stable version
Learn more about best practices

Repository

github.com/charlievieth/utils

Links

Open Source Insights

Documentation ¶

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

func IsComment ¶

func IsComment(r rune) bool

func IsEscape ¶

func IsEscape(r rune) bool

func IsEscapedQuote ¶

func IsEscapedQuote(r rune) bool

func IsPosixWord ¶

func IsPosixWord(r rune) bool

func IsPunctuation ¶

func IsPunctuation(r rune) bool

func IsQuote ¶

func IsQuote(r rune) bool

func IsWhitespace ¶

func IsWhitespace(r rune) bool

func IsWord ¶

func IsWord(r rune) bool

Types ¶

type Token ¶

type Token int8

const (
	None Token = iota
	// TODO: do we need a PosixWord Token ???
	Word
	Whitespace
	Quote
	Escape
	// EscapedQuote // TODO: do we need this ?
	Punctuation
	Comment
)

func Classify ¶

func Classify(r rune) Token

func (Token) String ¶

func (i Token) String() string

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL