moe

spark_model::layers::deepseek_v41_ref::moe

Function moe 

Source 
pub fn moe(
    x: &[f32],
    tokens: usize,
    w: &MoeWeights<'_>,
    c: &MoeCfg,
) -> (Vec<f32>, Vec<f32>, Vec<usize>)
Expand description

MoE.forward (single rank). Returns (y[tokens, dim] bf16 values, routing weights, routing indices).