select_candidate_blocks

Function select_candidate_blocks 

Source
pub fn select_candidate_blocks(
    logits: &[f32],
    queries: usize,
    width: usize,
    compress_lens: &[usize],
    topk_blocks: usize,
    block: usize,
) -> Vec<bool>
Expand description

select_candidate_blocks: logits[queries][width] with unreachable positions at -inf; compress_lens[q]. Returns the keep mask [queries][width].