Applies the randomized leaky rectified liner unit function, element-wise, as described in the paper:
Details
Empirical Evaluation of Rectified Activations in Convolutional Network
.
The function is defined as:
where
Examples
if (torch_is_installed()) {
m <- nn_rrelu(0.1, 0.3)
input <- torch_randn(2)
m(input)
}
#> torch_tensor
#> -0.1234
#> -0.2292
#> [ CPUFloatType{2} ]