silu

Function silu 

Source
pub fn silu(x: f32) -> f32
Expand description

SiLU: x * sigmoid(x). Used by KDA short-conv. Decay f_a is a plain linear.