decoder

Documentation

Index

• type KeysValuesPairs
• type Model
  • func New(config config.Config) *Model
  • func (m *Model) Decode(xs []ag.Node, encoderHiddenStates []ag.Node, ...) ([]ag.Node, KeysValuesPairs)

Types

type KeysValuesPairs

type KeysValuesPairs = []layer.KeysValuesPairs

KeysValuesPairs contains the layer.KeysValuesPairs for each decoding layer.

type Model

type Model struct {
	nn.BaseModel
	Config             config.Config
	PositionalEncoder  positionalencoder.Encoder
	Layers             []*layer.Layer
	EmbeddingLayerNorm *layernorm.Model
	LayerNorm          *layernorm.Model
}

Model implements a BART decoder.

func New

func New(config config.Config) *Model

New returns a new BART decoder Model.

func (*Model) Decode

func (m *Model) Decode(
	xs []ag.Node,
	encoderHiddenStates []ag.Node,
	pastKeysValuesPairs KeysValuesPairs,
) ([]ag.Node, KeysValuesPairs)

Decode performs the forward step for each input and returns the result.