bartencoder

Documentation

Index

• type Layer
  • func NewLayer(config bartconfig.Config) *Layer
  • func (m *Layer) Forward(xs ...ag.Node) []ag.Node
• type Model
  • func New(config bartconfig.Config) *Model
  • func (m *Model) Encode(xs []ag.Node) []ag.Node

Types

type Layer

type Layer struct {
	nn.BaseModel
	Config                 bartconfig.Config
	SelfAttention          *multiheadattention.Model
	SelfAttentionLayerNorm *layernorm.Model
	FFN                    *stack.Model
	LayerNorm              *layernorm.Model
}

Layer implements a BART encoder layer.

func NewLayer

func NewLayer(config bartconfig.Config) *Layer

NewLayer returns a new BART encoder Layer.

func (*Layer) Forward

func (m *Layer) Forward(xs ...ag.Node) []ag.Node

Forward performs the forward step for each input node and returns the result.

type Model

type Model struct {
	nn.BaseModel
	Config                      bartconfig.Config
	Layers                      *stack.Model
	LearnedPositionalEmbeddings *posembeddings.LearnedPositionalEmbeddings
	EmbeddingLayerNorm          *layernorm.Model
	LayerNorm                   *layernorm.Model
}

Model implements a BART encoder.

func New

func New(config bartconfig.Config) *Model

New returns a new BART encoder Model.

func (*Model) Encode

func (m *Model) Encode(xs []ag.Node) []ag.Node

Encode performs the forward step for each input node and returns the result.