slstm

Documentation

Overview

Package slstm implements a Sentence-State LSTM graph neural network.

Reference: "Sentence-State LSTM for Text Representation" by Zhang et al, 2018. (https://arxiv.org/pdf/1805.02474.pdf)

Index

• type Config
• type HyperLinear3
• type HyperLinear4
• type Model
  • func New(config Config) *Model
  • func (m *Model) Forward(xs ...ag.Node) []ag.Node
• type Support

Types

type Config

type Config struct {
	InputSize  int
	OutputSize int
	Steps      int
}

Config provides configuration settings for a Sentence-State LSTM Model.

type HyperLinear3

type HyperLinear3 struct {
	W nn.Param `spago:"type:weights"`
	U nn.Param `spago:"type:weights"`
	B nn.Param `spago:"type:biases"`
}

HyperLinear3 groups multiple params for an affine transformation.

type HyperLinear4

type HyperLinear4 struct {
	W nn.Param `spago:"type:weights"`
	U nn.Param `spago:"type:weights"`
	V nn.Param `spago:"type:weights"`
	B nn.Param `spago:"type:biases"`
}

HyperLinear4 groups multiple params for an affine transformation.

type Model

type Model struct {
	nn.BaseModel
	Config                 Config
	InputGate              *HyperLinear4 `spago:"type:params"`
	LeftCellGate           *HyperLinear4 `spago:"type:params"`
	RightCellGate          *HyperLinear4 `spago:"type:params"`
	CellGate               *HyperLinear4 `spago:"type:params"`
	SentCellGate           *HyperLinear4 `spago:"type:params"`
	OutputGate             *HyperLinear4 `spago:"type:params"`
	InputActivation        *HyperLinear4 `spago:"type:params"`
	NonLocalSentCellGate   *HyperLinear3 `spago:"type:params"`
	NonLocalInputGate      *HyperLinear3 `spago:"type:params"`
	NonLocalSentOutputGate *HyperLinear3 `spago:"type:params"`
	StartH                 nn.Param      `spago:"type:weights"`
	EndH                   nn.Param      `spago:"type:weights"`
	InitValue              nn.Param      `spago:"type:weights"`
	Support                Support       `spago:"scope:processor"`
}

Model contains the serializable parameters.

func New

func New(config Config) *Model

New returns a new model with parameters initialized to zeros.

func (*Model) Forward

func (m *Model) Forward(xs ...ag.Node) []ag.Node

Forward performs the forward step for each input node and returns the result.

type Support

type Support struct {

	// Shared among all nodes at the same step
	ViPrevG ag.Node
	VlPrevG ag.Node
	VrPrevG ag.Node
	VfPrevG ag.Node
	VsPrevG ag.Node
	VoPrevG ag.Node
	VuPrevG ag.Node
	// contains filtered or unexported fields
}

Support contains nodes used during the forward step.