pub fn silu(x: f32) -> f32
SiLU: x * sigmoid(x). Used by KDA short-conv. Decay f_a is a plain linear.
x * sigmoid(x)
f_a