attnres_mix

spark_model::kimi_k3

Function attnres_mix 

Source 
pub fn attnres_mix(
    sources: &[Vec<f32>],
    query: &[f32],
    norm_w: &[f32],
    eps: f32,
    mix: f32,
) -> Vec<f32>
Expand description

Apply AttnRes with an explicit mix lever. mix=0 is identity skip.