DENSE_GEMM_M16_BF16_K_STEP

Constant DENSE_GEMM_M16_BF16_K_STEP 

Source
pub const DENSE_GEMM_M16_BF16_K_STEP: u32 = 64;
Expand description

K granularity: the 4-stage cp.async pipeline advances 64 elements per step, and 64 BF16 is also what keeps every 16-byte weight-row chunk aligned.