Selu — nnf_selu • torch

Applies element-wise, $S E L U (x) = s c a l e * (m a x (0, x) + m i n (0, α * (e x p (x) - 1)))$ , with $α = 1.6732632423543772848170429916717$ and $s c a l e = 1.0507009873554804934193349852946$ .

Usage

nnf_selu(input, inplace = FALSE)

nnf_selu_(input)

Arguments

input: (N,*) tensor, where * means, any number of additional dimensions
inplace: can optionally do the operation in-place. Default: FALSE

Examples

if (torch_is_installed()) {
x <- torch_randn(2, 2)
y <- nnf_selu(x)
nnf_selu_(x)
torch_equal(x, y)
}
#> [1] TRUE