Struct DerivedResidency 

pub struct DerivedResidency {
    pub kept: u64,
    pub skipped: u64,
    pub freed: u64,
    pub twins: TwinsBuilt,
}

Running tally of the derived (non-checkpoint) device bytes this loader allocated, and of the ones it decided not to build.

Counted in the loader rather than read back from the ledger because the ledger cannot tell a derived copy from a checkpoint tensor — both are plain gpu.alloc — and because the “not built” number is the one the fix is judged on and has no allocation to read.

Fields

kept: u64

Derived bytes still resident at the end of load.

skipped: u64

Derived bytes the plan declined to build, versus the pre-#915 loader.

freed: u64

Transient derived bytes allocated and freed during load.

twins: TwinsBuilt

Which twin families were built, for the one-line summary.

Implementations

impl DerivedResidency

pub fn keep(&mut self, bytes: usize)

pub fn skip(&mut self, bytes: usize)

pub fn free(&mut self, bytes: usize)

pub fn summary(&self, weight_bytes: usize) -> String

The line the next H100 run is read against.

Emitted at the end of load_layers so a serve log proves the residency without an ATLAS_MEM_PROFILE rerun: weights is the checkpoint, derived is everything this loader built on top of it, and skipped is what the pre-#915 loader would have built and this one did not.

Trait Implementations

impl Clone for DerivedResidency

fn clone(&self) -> DerivedResidency

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DerivedResidency

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for DerivedResidency

fn default() -> DerivedResidency

Returns the “default value” for a type.

impl PartialEq for DerivedResidency

fn eq(&self, other: &DerivedResidency) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for DerivedResidency

impl Eq for DerivedResidency

impl StructuralPartialEq for DerivedResidency