Enum DerivedBytesEstimate 

pub enum DerivedBytesEstimate {
    NativeFp8Dense(PredictedDerived),
    Unavailable(&'static str),
}

The answer, or an honest refusal to answer.

Variants

NativeFp8Dense(PredictedDerived)

The native-FP8 dense route will run and its derived bytes are this.

Unavailable(&'static str)

No prediction. The &'static str is the reason, written to be readable in a serve log (… — falling back to pre-load free memory (<reason>)).

Implementations

impl DerivedBytesEstimate

pub fn bytes(&self) -> Option<u64>

Predicted bytes, or None when unavailable.

pub fn reason(&self) -> Option<&'static str>

Trait Implementations

impl Clone for DerivedBytesEstimate

fn clone(&self) -> DerivedBytesEstimate

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DerivedBytesEstimate

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for DerivedBytesEstimate

fn eq(&self, other: &DerivedBytesEstimate) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for DerivedBytesEstimate

impl Eq for DerivedBytesEstimate

impl StructuralPartialEq for DerivedBytesEstimate