Expand description
Per-sequence K3 state: resident CUDA KDA recurrence and MLA KV.
Prefix-cache restore reuses C3 CPU LayerCache bytes. Not EmptyLayerState.
Structsยง
- K3Cpu
Fallback State - Mixer state owned by one sequence; released through the layer release hook.