Module dense_cuda

Module dense_cuda 

Source
Expand description

Opt-in K3 dense/shared MLP using original resident weights and FP32 I/O. Only input and final output cross the host boundary; no weight duplication.

Functionsยง

launch_dense_matrices
Explicit resident matrix ABI, also used by real-device numerical tests.
launch_dense_mlp
Dense and shared expert matrices are already TP-sharded in the loader.