Struct MlaKv 

pub struct MlaKv {
    pub k: Vec<f32>,
    pub v: Vec<f32>,
    pub seq_len: usize,
}

One MLA layer’s host KV (unpaged CPU stand-in).

Fields

k: Vec<f32>

Packed keys [T, H, dq].

v: Vec<f32>

Packed values [T, H, dv].

seq_len: usize

Implementations

impl MlaKv

pub fn append(&mut self, k: &[f32], v: &[f32])

Append one token’s packed K/V ([H, dq] / [H, dv]).

Trait Implementations

impl Clone for MlaKv

fn clone(&self) -> MlaKv

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for MlaKv

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for MlaKv

fn default() -> MlaKv

Returns the “default value” for a type.