Struct Fp8KvWriteTarget 

pub struct Fp8KvWriteTarget {
    pub kernel: KernelHandle,
    pub k_pool: DevicePtr,
    pub v_pool: DevicePtr,
    pub block_size: u32,
    pub cache_stride: u64,
    pub key_stride: u32,
    pub value_stride: u32,
    pub slot: DevicePtr,
}

Everything the replay needs to re-run reshape_and_cache_fp8 for one layer.

Fields

kernel: KernelHandle

reshape_and_cache_fp8 kernel handle (the layer’s reshape_cache_k).

k_pool: DevicePtr

Base pointer of this layer’s K pool.

v_pool: DevicePtr

Base pointer of this layer’s V pool.

block_size: u32

Tokens per KV block.

cache_stride: u64

Pool stride in ELEMENTS (block_size * num_kv_heads * head_dim).

key_stride: u32

Source K row stride in elements, as passed to the live write.

value_stride: u32

Source V row stride in elements, as passed to the live write.

slot: DevicePtr

This batch’s slot_mapping (int64 per token), staged alongside the BF16 K/V so the replay lands on exactly the entries the window wrote.

Trait Implementations

impl Clone for Fp8KvWriteTarget

fn clone(&self) -> Fp8KvWriteTarget

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Fp8KvWriteTarget

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Copy for Fp8KvWriteTarget