CELU module — nn_celu • torch

Applies the element-wise function:

Usage

nn_celu(alpha = 1, inplace = FALSE)

Arguments

alpha: the $α$ value for the CELU formulation. Default: 1.0
inplace: can optionally do the operation in-place. Default: FALSE

Details

$CELU (x) = max (0, x) + min (0, α * (\exp (x / α) - 1))$

More details can be found in the paper Continuously Differentiable Exponential Linear Units.

Shape

Input: $(N, *)$ where * means, any number of additional dimensions
Output: $(N, *)$ , same shape as the input

Examples

if (torch_is_installed()) {
m <- nn_celu()
input <- torch_randn(2)
output <- m(input)
}