greedy_decode

Function greedy_decode 

Source
pub fn greedy_decode(
    model: &K3CpuModel,
    prompt: &[u32],
    max_new: usize,
    ablation: Ablation,
) -> Vec<u32>
Expand description

Greedy decode. Returns prompt || new_tokens (length prompt.len() + max_new).