Expand description
K3 device-binding adapter for the shared tensor-parallel storage plan. Runtime loading partitions packed and dense weights before GPU allocation.
Head counts on config are already per-rank. Full sizes = local * tp.
Functionsยง
- supports_
tp - K3 does tensor-parallel. Callers must not fail-fast
supports_tpfalse. - tensor_
plan (kind, full_out, full_in)for one checkpoint key.