Members
IDENTITY
Identity is a linear function where the output is equal to the input.
x => x
LEAKY_RE_LU
LeakyReLU gives a small proportion of x if x is negative and x otherwise.
x => (x < 0.0) ? 0.01 * x : x
SIGMOID
Sigmoid takes any value as input and outputs values in the range of 0.0 to 1.0.
x => 1.0 / (1.0 + Math.exp(-x))
TANH
Tanh is similar to sigmoid, but outputs values in the range of -1.0 and 1.0.
x => Math.tanh(x)