launch_dense_matrices

Function launch_dense_matrices 

Source
pub fn launch_dense_matrices(
    gpu: &dyn GpuBackend,
    x: &[f32],
    gate: DevicePtr,
    up: DevicePtr,
    down: DevicePtr,
    gate_dtype: u32,
    down_dtype: u32,
    hidden: usize,
    inter: usize,
    beta: f32,
    linear_beta: f32,
    stream: u64,
) -> Result<Vec<f32>>
Expand description

Explicit resident matrix ABI, also used by real-device numerical tests.