LeakyReLUOperator

public class LeakyReLUOperator: ELUOperator

LeakyReLU activation operator.

y = alpha * x (x <   0)
y = x         (x >=  0)

scale factor alpha

Default value is 0.3

Reference

Rectifier Nonlinearities Improve Neural Network Acoustic Models