Enum SplitkPolicy 

pub enum SplitkPolicy {
    Legacy,
    Auto,
    Pinned(u32),
}

How a target picks its paged-decode split count.

Variants

Legacy

The pre-#928 rule: sm_count / (num_q_heads * split_ref_seqs), or 1 when that product already covers the device. Reads the runtime reference batch, which is why it is not the default anywhere new.

Auto

Fill SPLITK_TARGET_WAVES waves at the SINGLE-STREAM shape: clamp(ceil(WAVES * sm_count / num_q_heads), 1, MAX_DECODE_SPLITS).

Pinned(u32)

An operator-pinned count, clamped to 1..=MAX_DECODE_SPLITS. 0 and off arrive here as Pinned(1) — one split IS no split-K.

Implementations

impl SplitkPolicy

pub fn label(self) -> String

The spelling this policy round-trips through parse, for the serve log’s target defaults (<hw>): … line.

Trait Implementations

impl Clone for SplitkPolicy

fn clone(&self) -> SplitkPolicy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SplitkPolicy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for SplitkPolicy

fn eq(&self, other: &SplitkPolicy) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for SplitkPolicy

impl Eq for SplitkPolicy

impl StructuralPartialEq for SplitkPolicy