Struct AttnV41LayerState 

pub struct AttnV41LayerState { /* private fields */ }

One layer’s device state across prefill and decode.

Implementations

impl AttnV41LayerState

pub fn new( gpu: &dyn GpuBackend, c: &AttnV41Cfg, role: LayerRole, ) -> Result<Self>

pub fn window(&self) -> DevicePtr

The window ring, bf16 [window, hd]: a pointer a captured decode step bakes.

pub fn free(&mut self, gpu: &dyn GpuBackend) -> Result<()>

Free the four device buffers this sequence owns and clear the pointers. Idempotent: gpu.free is null-safe and the taken options stay None, so a second call frees nothing. Takes &mut self because the state reaches release_state as &mut dyn LayerState and cannot be moved out of the box.