sinusoidalpositionalencoder

Documentation

Index

• type Config
• type SinusoidalPositionalEncoder
  • func New(config Config) *SinusoidalPositionalEncoder
  • func (m *SinusoidalPositionalEncoder) Encode(positions []int) []ag.Node

Types

type Config

type Config struct {
	NumEmbeddings int
	EmbeddingDim  int
}

Config provides configuration settings for a SinusoidalPositionalEncoder Model.

type SinusoidalPositionalEncoder

type SinusoidalPositionalEncoder struct {
	nn.BaseModel
	Config   Config
	Delegate *pe.SinusoidalPositionalEncoder
}

SinusoidalPositionalEncoder contains positional embeddings fine-tuned during the training phase.

func New

func New(config Config) *SinusoidalPositionalEncoder

New returns a new SinusoidalPositionalEncoder.

func (*SinusoidalPositionalEncoder) Encode

func (m *SinusoidalPositionalEncoder) Encode(positions []int) []ag.Node

Encode performs the forward step for each input and returns the result.