kda_recurrent_step

Function kda_recurrent_step 

Source
pub fn kda_recurrent_step(
    qkv: &[f32],
    gate: &[f32],
    beta: &[f32],
    cfg: &KdaConfig,
    recurrent: &mut [f32],
) -> Vec<f32>
Expand description

One-token KDA core. qkv is post-conv [3 * qkv_dim] (q|k|v). Updates state.recurrent in place. q/k are L2-normalised here.