Struct SegState 

pub struct SegState {

    pub disabled: bool,
    pub skip_until: usize,
    pub eager_until: usize,
    pub ffn_only_at: Option<usize>,
    pub capturing: Option<SegCapture>,
    pub graphs: Vec<Option<SegGraph>>,
    pub baked: Option<[DevicePtr; 3]>,
    pub cap_stream: Option<u64>,
    pub cap_side: u64,
    pub ev_fork: u64,
    pub ev_join: u64,
    pub save: Vec<[DevicePtr; 5]>,
    pub windows: Vec<DevicePtr>,
    pub stale: bool,
    pub launches: u64,
    pub reruns: u64,
}

Fields

disabled: bool

A capture failed: the mode is off for the process.

skip_until: usize

Layers below this were covered by the segment just launched.

eager_until: usize

Layers below this run the whole eager step this token.

ffn_only_at: Option<usize>

The layer whose snapshot the owner restored: it runs from its ffn on.

capturing: Option<SegCapture>

graphs: Vec<Option<SegGraph>>

By owner layer.

baked: Option<[DevicePtr; 3]>

The buffers every graph bakes: hidden, streams, normed.

cap_stream: Option<u64>

The stream a capture token records on, the side stream the recorded shared expert forks onto, and the fork / join events (all captured into the graph; the eager path’s own side stream is never touched).

cap_side: u64

ev_fork: u64

ev_join: u64

save: Vec<[DevicePtr; 5]>

Per layer, the snapshot before its ffn (step_seg_run::SAVE_N buffers: hidden, streams, pre_prev, pre_a, the attention output, post_s, comb_s).

windows: Vec<DevicePtr>

Every layer’s window ring as last seen (note_window): a sequence’s own buffer the captured attention bodies bake.

stale: bool

A window ring changed since the graphs were captured: recapture.

launches: u64

Graph launches and miss falls this process, for the log.

reruns: u64

Trait Implementations

impl Default for SegState

fn default() -> SegState

Returns the “default value” for a type.