predicted_derived_bytes

spark_model::weight_loader::predicted_residency

Function predicted_derived_bytes 

Source 
pub fn predicted_derived_bytes(
    config: &ModelConfig,
    route: &Fp8RouteInputs,
) -> DerivedBytesEstimate
Expand description

Bytes the native-FP8 dense loader will derive on top of the checkpoint.

Pure: no environment reads, no allocation, no device access. The route argument carries everything impure (see Fp8RouteInputs::from_env), so the decision table below is testable at exact integers.