R/nnf-activation.R
nnf_hardswish.Rd
Applies the hardswish function, element-wise, as described in the paper: Searching for MobileNetV3.
nnf_hardswish(input, inplace = FALSE)
(N,*) tensor, where * means, any number of additional dimensions
can optionally do the operation in-place. Default: FALSE
Hardswish(x)={0if x≤−3,xif x≥+3,x⋅(x+3)/6otherwise