Enum ExpertArena 

pub enum ExpertArena {
    Pinned(PinnedArena),
    Device(DeviceArena),
}

Either arena, as the runtime that keeps it alive holds it.

Variants

Pinned(PinnedArena)

Page-locked host memory the GPU reads in place.

Device(DeviceArena)

Device memory behind the staging ring.

Implementations

impl ExpertArena

pub fn alloc( gpu: &dyn GpuBackend, bytes: usize, layout: SlotLayout, device: bool, ring_slots: usize, ) -> Result<(Self, ExpertLru)>

The arena of bytes and the cache over it: device slots with a ring_slots staging ring when device, the page-locked arena otherwise.

pub fn bytes(&self) -> usize

pub fn describe(&self) -> String

One line for the load log.

pub fn free(self, gpu: &dyn GpuBackend) -> Result<()>