Fills the input Tensor
with values according to the method
described in Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification
- He, K. et al. (2015), using a
normal distribution.
Arguments
- tensor
an n-dimensional
torch.Tensor
- a
the negative slope of the rectifier used after this layer (only used with
'leaky_relu'
)- mode
either 'fan_in' (default) or 'fan_out'. Choosing 'fan_in' preserves the magnitude of the variance of the weights in the forward pass. Choosing 'fan_out' preserves the magnitudes in the backwards pass.
- nonlinearity
the non-linear function. recommended to use only with 'relu' or 'leaky_relu' (default).
Examples
if (torch_is_installed()) {
w <- torch_empty(3, 5)
nn_init_kaiming_normal_(w, mode = "fan_in", nonlinearity = "leaky_relu")
}
#> torch_tensor
#> -1.0250 -0.5504 -0.3411 0.0176 -0.4663
#> -1.2294 0.0914 -0.6502 0.4310 -0.6771
#> 0.5450 1.2748 0.6698 0.3655 -0.6557
#> [ CPUFloatType{3,5} ]