learnedpositionalencoder

Documentation

Index

• type Config
• type LearnedPositionalEncoder
  • func New(config Config) *LearnedPositionalEncoder
  • func (m *LearnedPositionalEncoder) Encode(positions []int) []ag.Node

Types

type Config

type Config struct {
	NumEmbeddings int
	EmbeddingDim  int
	PaddingIDX    int
	Offset        int
}

Config provides configuration settings for a LearnedPositionalEncoder Model.

type LearnedPositionalEncoder

type LearnedPositionalEncoder struct {
	nn.BaseModel
	Config  Config
	Vectors []nn.Param `spago:"type:weights;scope:model"`
}

LearnedPositionalEncoder contains positional embeddings fine-tuned during the training phase.

func New

func New(config Config) *LearnedPositionalEncoder

New returns a new LearnedPositionalEncoder. TODO: PaddingIDX

func (*LearnedPositionalEncoder) Encode

func (m *LearnedPositionalEncoder) Encode(positions []int) []ag.Node

Encode performs the forward step for each input and returns the result.