required_model_recv_bytes

Function required_model_recv_bytes 

Source
pub fn required_model_recv_bytes(
    tokens: usize,
    hidden: usize,
    vocab: usize,
) -> Result<usize>
Expand description

Bound both hidden activations and vocabulary-parallel logits. Logits can exceed the hidden-state arena even for one token (e.g. small K3 twins).