Hardshwink module

Usage

nn_hardshrink(lambd = 0.5)

Arguments

lambd

the $\lambda$ value for the Hardshrink formulation. Default: 0.5

Details

$$\text{HardShrink}(x)=\{\begin{array}{ll}x,& \text{ if }x>\lambda \\ x,& \text{ if }x<-\lambda \\ 0,& \text{ otherwise }\end{array}$$

Shape

• Input: $(N,\ast )$ where * means, any number of additional dimensions

• Output: $(N,\ast )$, same shape as the input

Examples

if (torch_is_installed()) {
m <- nn_hardshrink()
input <- torch_randn(2)
output <- m(input)
}