Hardswish module

Usage

nn_hardswish()

Details

$$\text{Hardswish}(x)=\{\begin{array}{ll}0& \text{if }x\le -3,\\ x& \text{if }x\ge +3,\\ x\cdot (x+3)/6& \text{otherwise}\end{array}$$

Shape

• Input: $(N,\ast )$ where * means, any number of additional dimensions

• Output: $(N,\ast )$, same shape as the input

Examples

if (torch_is_installed()) {
if (FALSE) { # \dontrun{
m <- nn_hardswish()
input <- torch_randn(2)
output <- m(input)
} # }

}