Struct RdmaWeightLoader 

pub struct RdmaWeightLoader {
    pub peer_addr: String,
    pub model_id: Option<String>,
    pub ep_rank: usize,
    pub ep_world_size: usize,
    pub num_experts: usize,
    pub stream_all_experts: bool,
    pub peak_memory_multiplier: Option<f64>,
}

Loads a model’s resident weights from a weight_peer over one-sided RDMA.

Fields

peer_addr: String

host:port of the weight peer (from $AVAROK_WEIGHT_PEER).

model_id: Option<String>

Model id/path to request. When None, the loader sends the model_dir path passed to load (so the client and peer agree on the local path).

ep_rank: usize

ep_world_size: usize

num_experts: usize

stream_all_experts: bool

Expert streaming: skip ALL routed-expert tensors (served from the expert peer). Set from config.expert_streaming at the call site.

peak_memory_multiplier: Option<f64>

Pre-flight OOM multiplier override (advisory; parity with disk loaders).

Implementations

impl RdmaWeightLoader

pub fn new(peer_addr: String) -> Self

pub fn with_ep( peer_addr: String, ep_rank: usize, ep_world_size: usize, num_experts: usize, ) -> Self

Trait Implementations

impl WeightLoader for RdmaWeightLoader

fn load( &self, model_dir: &Path, gpu: &dyn GpuBackend, oom_reserve_bytes: usize, ) -> Result<WeightStore>