pub const LATENT_BLOCK: usize = 16;
Block size the compressed KV latent is quantised with (fp4_act_quant(latent, 16, ...)).
fp4_act_quant(latent, 16, ...)