Leaky_relu — nnf_leaky_relu • torch

Applies element-wise, $L e a k y R e L U (x) = m a x (0, x) + n e g a t i v e_{s} l o p e * m i n (0, x)$

Usage

nnf_leaky_relu(input, negative_slope = 0.01, inplace = FALSE)

Arguments

input: (N,*) tensor, where * means, any number of additional dimensions
negative_slope: Controls the angle of the negative slope. Default: 1e-2
inplace: can optionally do the operation in-place. Default: FALSE