semtok

Documentation

Overview

The semtok package provides an encoder for LSP's semantic tokens.

Index

• func Encode(tokens []Token, noStrings, noNumbers bool, types, modifiers []string) []uint32
• type Token
• type TokenType

Functions

func Encode

func Encode(
	tokens []Token,
	noStrings, noNumbers bool,
	types, modifiers []string) []uint32

Encode returns the LSP encoding of a sequence of tokens. The noStrings, noNumbers options cause strings, numbers to be skipped. The lists of types and modifiers determines the bitfield encoding.

Types

type Token

type Token struct {
	Line, Start uint32
	Len         uint32
	Type        TokenType
	Modifiers   []string
}

A Token provides the extent and semantics of a token.

type TokenType

type TokenType string

const (
	// These are the tokens defined by LSP 3.17, but a client is
	// free to send its own set; any tokens that the server emits
	// that are not in this set are simply not encoded in the bitfield.
	TokNamespace TokenType = "namespace"
	TokType      TokenType = "type"
	TokInterface TokenType = "interface"
	TokTypeParam TokenType = "typeParameter"
	TokParameter TokenType = "parameter"
	TokVariable  TokenType = "variable"
	TokMethod    TokenType = "method"
	TokFunction  TokenType = "function"
	TokKeyword   TokenType = "keyword"
	TokComment   TokenType = "comment"
	TokString    TokenType = "string"
	TokNumber    TokenType = "number"
	TokOperator  TokenType = "operator"
	TokMacro     TokenType = "macro" // for templates

	// not part of LSP 3.17 (even though JS has labels)
	// https://github.com/microsoft/vscode-languageserver-node/issues/1422
	TokLabel TokenType = "label"
)