View on GitHub
Install in Dash
Optimizer Protocol Reference
Optimizer
public protocol OptimizerThis protocol defines the API and behavior of an optimizer.
-
/ Initial set learning reate
Declaration
Swift
var initLearningRate: Float -
Learning rate of current epoch
Declaration
Swift
var learningRate: Float -
Decay method
Declaration
Swift
var decayMethod: LearningRateDecayMethod -
Do preapre work before 1st backward if needed.
Declaration
Swift
func prepare(_ graph: Graph) -
Update a data symbol’s updated value
/ - Parameters:
- dataSymbol: target symbol
- gradValue: gradvalue fot this time updating
Declaration
Swift
func updateParameter(_ dataSymbol: DataSymbol, gradValue: DataSymbolSupportedDataType)