activation

Documentation

Index

• type Activation
  • func MustParseActivation(str string) Activation
  • func ParseActivation(str string) (Activation, error)
• type Model
  • func New(activation Activation, params ...*nn.Param) *Model
  • func (m *Model) Forward(xs ...mat.Tensor) []mat.Tensor

Types

type Activation

type Activation int

Activation is the enumeration-like type used for the set of built-in activations.

const (
	Identity Activation = iota
	Tan
	Tanh
	Sigmoid
	HardSigmoid
	HardTanh
	Softsign
	ReLU
	CELU
	GELU
	ELU
	PositiveELU
	SwishB
	Swish
	SiLU
	Mish
	LeakyReLU
	SELU
	SoftPlus
	SoftShrink
	Threshold
	Softmax
	LogSoftmax
	SparseMax
)

func MustParseActivation

func MustParseActivation(str string) Activation

MustParseActivation maps a string to an activation function. It panics if the string does not match any built-in activation (not even using lowercase).

func ParseActivation

func ParseActivation(str string) (Activation, error)

ParseActivation maps a string to an activation function. It returns an error if the string does not match any built-in activation (not even using lowercase).

type Model

type Model struct {
	nn.Module
	Activation Activation
	Params     []*nn.Param
}

func New

func New(activation Activation, params ...*nn.Param) *Model

func (*Model) Forward

func (m *Model) Forward(xs ...mat.Tensor) []mat.Tensor