slstm

Documentation

Overview

Package slstm implements a Sentence-State LSTM graph neural network.

Reference: "Sentence-State LSTM for Text Representation" by Zhang et al, 2018. (https://arxiv.org/pdf/1805.02474.pdf)

Index

• type Config
• type HyperLinear3
• type HyperLinear4
• type Model
  • func New[T float.DType](config Config) *Model
  • func (m *Model) Forward(xs ...ag.Node) []ag.Node
• type State

Types

type Config

type Config struct {
	InputSize  int
	OutputSize int
	Steps      int
}

Config provides configuration settings for a Sentence-State LSTM Model.

type HyperLinear3

type HyperLinear3 struct {
	nn.Module
	W nn.Param `spago:"type:weights"`
	U nn.Param `spago:"type:weights"`
	B nn.Param `spago:"type:biases"`
}

HyperLinear3 groups multiple params for an affine transformation.

type HyperLinear4

type HyperLinear4 struct {
	nn.Module
	W nn.Param `spago:"type:weights"`
	U nn.Param `spago:"type:weights"`
	V nn.Param `spago:"type:weights"`
	B nn.Param `spago:"type:biases"`
}

HyperLinear4 groups multiple params for an affine transformation.

type Model

type Model struct {
	nn.Module
	Config                 Config
	InputGate              *HyperLinear4
	LeftCellGate           *HyperLinear4
	RightCellGate          *HyperLinear4
	CellGate               *HyperLinear4
	SentCellGate           *HyperLinear4
	OutputGate             *HyperLinear4
	InputActivation        *HyperLinear4
	NonLocalSentCellGate   *HyperLinear3
	NonLocalInputGate      *HyperLinear3
	NonLocalSentOutputGate *HyperLinear3
	StartH                 nn.Param `spago:"type:weights"`
	EndH                   nn.Param `spago:"type:weights"`
	InitValue              nn.Param `spago:"type:weights"`
}

Model contains the serializable parameters.

func New

func New[T float.DType](config Config) *Model

New returns a new model with parameters initialized to zeros.

func (*Model) Forward

func (m *Model) Forward(xs ...ag.Node) []ag.Node

Forward performs the forward step for each input node and returns the result.

type State

type State struct {
	ViPrevG ag.Node
	VlPrevG ag.Node
	VrPrevG ag.Node
	VfPrevG ag.Node
	VsPrevG ag.Node
	VoPrevG ag.Node
	VuPrevG ag.Node
	// contains filtered or unexported fields
}

State contains nodes used during the forward step.