View on GitHub
Install in Dash
SELUOperator Class Reference
SELUOperator
public class SELUOperator: ActivationOperatorScaled Exponential Linear Unit.
y = scale * elu(x)
alpha
default value is 1.673263
scale
default value is 1.050701
Reference
-
alpha for ELU operation. Default is
1.673263Declaration
Swift
public var alpha:Float = 1.673263 -
scalue factor. Defualt is
1.050701Declaration
Swift
public var scale:Float = 1.050701
-
Convenience initializer Subclass required to override this function to assign
cpuComputeBlockandmetalKernelFuncLabelDeclaration
Swift
required public convenience init(computationDelegate: OperatorCalculationDelegate? = nil)Parameters
computationDelegatecomputationDelegate
-
Declaration
Swift
public convenience init(computationDelegate: OperatorCalculationDelegate? = nil, alpha: Float, scale:Float)Parameters
computationDelegatecomputationDelegate description
alphaalpha description
-
Attribute
alphaas aScalarSymbol. Attributescaleas aScalarSymbolDeclaration
Swift
public override func paramSymbols() -> [GraphSymbol]Return Value
Array of GraphSymbol
-
Override CPU
Declaration
Swift
internal override func cpu() -
Override GPU calculation cause there’s a hyperparameter to pass-in
Declaration
Swift
internal override func gpu()