R/nnf-activation.R
nnf_leaky_relu.Rd
Applies element-wise, \(LeakyReLU(x) = max(0, x) + negative_slope * min(0, x)\)
nnf_leaky_relu(input, negative_slope = 0.01, inplace = FALSE)
(N,*) tensor, where * means, any number of additional dimensions
Controls the angle of the negative slope. Default: 1e-2
can optionally do the operation in-place. Default: FALSE