KDA_L2_EPS

atlas_core::kimi_k3::kda

Constant KDA_L2_EPS 

Source 
pub const KDA_L2_EPS: f32 = 1e-6;
Expand description

FLA use_qk_l2norm_in_kernel eps. CUDA k3_kda_recurrent_step_f32 uses the same.