dequant_to_f32

Function dequant_to_f32 

Source
pub fn dequant_to_f32(
    t: GgmlType,
    block_bytes: &[u8],
    n_elements: usize,
    out: &mut [f32],
) -> Result<()>
Expand description

Dequantize n_elements from packed block_bytes into out as f32.

block_bytes must contain at least ceil(n_elements / block_size) whole blocks; n_elements must be a whole multiple of the type’s block size (GGUF tensors always are — the last dim is padded to the block size).