pub struct DecodeW8a8Scratch {
pub act_fp8: DevicePtr,
pub act_fp8_bytes: usize,
pub act_scale: DevicePtr,
pub act_scale_bytes: usize,
pub act_scale_kmajor: DevicePtr,
pub act_scale_kmajor_bytes: usize,
pub quant_k: Fp8ActQuant,
pub scale_kmajor_k: KernelHandle,
}Expand description
The activation-quant scratch triple + its capacities, read straight off the buffer arena at the call site. Bundled so the selector takes one argument instead of six and the tests can build it without an arena.
Fields§
§act_fp8: DevicePtr§act_fp8_bytes: usize§act_scale: DevicePtr§act_scale_bytes: usize§act_scale_kmajor: DevicePtr§act_scale_kmajor_bytes: usize§quant_k: Fp8ActQuant§scale_kmajor_k: KernelHandleTrait Implementations§
Source§impl Clone for DecodeW8a8Scratch
impl Clone for DecodeW8a8Scratch
Source§fn clone(&self) -> DecodeW8a8Scratch
fn clone(&self) -> DecodeW8a8Scratch
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for DecodeW8a8Scratch
impl Debug for DecodeW8a8Scratch
impl Copy for DecodeW8a8Scratch
Auto Trait Implementations§
impl Freeze for DecodeW8a8Scratch
impl RefUnwindSafe for DecodeW8a8Scratch
impl Send for DecodeW8a8Scratch
impl Sync for DecodeW8a8Scratch
impl Unpin for DecodeW8a8Scratch
impl UnwindSafe for DecodeW8a8Scratch
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more