yarn_freqs_cis

Function yarn_freqs_cis 

Source
pub fn yarn_freqs_cis(
    dim: usize,
    seqlen: usize,
    original_seq_len: usize,
    base: f32,
    factor: f32,
    beta_fast: f32,
    beta_slow: f32,
) -> Vec<(f32, f32)>
Expand description

precompute_freqs_cis WITH YaRN (original_seq_len > 0), as the compress layers build it from compress_rope_theta. [seqlen][dim/2] of (cos, sin).