pub struct TwinsBuilt {
pub ffn_nvfp4: bool,
pub attn_nvfp4: bool,
pub attn_fp8: bool,
pub ssm_fp8_concat: bool,
pub ffn_gateup_fused: bool,
}Expand description
Which derived twin families the plan built. Reported by name so the serve log says which copies are resident rather than only how many bytes.
Fields§
§ffn_nvfp4: bool§attn_nvfp4: bool§attn_fp8: bool§ssm_fp8_concat: bool§ffn_gateup_fused: boolThe dense-FFN [2*inter, hidden] gate+up concat (#927). Named in the
summary like the others, and worth naming even though it is residency-
NEUTRAL: its bytes appear in kept while the two store tensors they
replace disappear from WeightStore::resident_bytes at the prune, so a
reader comparing two serve logs needs to know which of the two numbers
moved and why.
Implementations§
Trait Implementations§
Source§impl Clone for TwinsBuilt
impl Clone for TwinsBuilt
Source§fn clone(&self) -> TwinsBuilt
fn clone(&self) -> TwinsBuilt
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for TwinsBuilt
impl Debug for TwinsBuilt
Source§impl Default for TwinsBuilt
impl Default for TwinsBuilt
Source§fn default() -> TwinsBuilt
fn default() -> TwinsBuilt
Returns the “default value” for a type. Read more
Source§impl PartialEq for TwinsBuilt
impl PartialEq for TwinsBuilt
impl Copy for TwinsBuilt
impl Eq for TwinsBuilt
impl StructuralPartialEq for TwinsBuilt
Auto Trait Implementations§
impl Freeze for TwinsBuilt
impl RefUnwindSafe for TwinsBuilt
impl Send for TwinsBuilt
impl Sync for TwinsBuilt
impl Unpin for TwinsBuilt
impl UnwindSafe for TwinsBuilt
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.