Struct AttnResStream 

pub struct AttnResStream {
    pub completed: Vec<Vec<f32>>,
    pub partial: Vec<f32>,
    /* private fields */
}

Matches HF KimiDecoderLayer._forward_attn_residual: mix the incoming prefix with already-archived blocks, then at layer_idx % block_size == 0 archive that incoming prefix and reset the intra-block sum. Layer 0 therefore archives the embedding as its own source, not embed + mixer.

Fields

completed: Vec<Vec<f32>>

partial: Vec<f32>

Implementations

impl AttnResStream

pub fn new(hidden: usize, block_size: usize) -> Self

pub fn mix(&self, query: &[f32], norm_w: &[f32], eps: f32, mix: f32) -> Vec<f32>

Trait Implementations

impl Clone for AttnResStream

fn clone(&self) -> AttnResStream

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for AttnResStream

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.