nvfp4_bytes

Function nvfp4_bytes 

Source
pub fn nvfp4_bytes(n: usize, k: usize) -> usize
Expand description

Bytes one NVFP4 QuantizedWeight costs: packed [N, K/2] E2M1 nibbles plus the [N, K/16] per-group scale byte. Mirrors quantize_to_nvfp4 (weight_map/loaders_fp8.rs:229-230) and transpose_for_gemm_gs (weight_map/quantized.rs:261-262), which allocate the same two sizes.