DECODE_W8A8_ROWS

spark_model::layers::ops

Constant DECODE_W8A8_ROWS 

Source 
pub const DECODE_W8A8_ROWS: RangeInclusive<usize>;
Expand description

The row band this family owns: 5..=16 PADDED decode rows.

  • <= 4 is w8a16_gemv_batch4’s, and M=1 is the bit-exact scalar GEMV — at those widths the GEMV streams each weight once and no MMA tile beats it, which the round-7 receipt measures directly (ncol2 at M=2/M=4 is 16% and 11% SLOWER than the GEMV it replaces).
  • >= 17 is not a decode step on this ladder’s hot rungs and would need a different M pad; it stays on whatever tier owns it today.