ReLU module

Source: R/nn-activation.R

Applies the rectified linear unit function element-wise $$\mbox{ReLU}(x) = (x)^+ = \max(0, x)$$

nn_relu(inplace = FALSE)

Arguments

inplace

can optionally do the operation in-place. Default: FALSE

Shape

  • Input: \((N, *)\) where * means, any number of additional dimensions

  • Output: \((N, *)\), same shape as the input

Examples

if (torch_is_installed()) {
m <- nn_relu()
input <- torch_randn(2)
m(input)

}
#> torch_tensor
#>  2.0717
#>  0.3631
#> [ CPUFloatType{2} ]