LATENT_BLOCK

Constant LATENT_BLOCK 

Source
pub const LATENT_BLOCK: usize = 16;
Expand description

Block size the compressed KV latent is quantised with (fp4_act_quant(latent, 16, ...)).