EngramTables

spark_model::layers::deepseek_v41_ref::engram

Struct EngramTables

pub struct EngramTables {
    pub layer_ids: Vec<usize>,
    pub max_ngram: usize,
    pub n_heads: usize,
    pub head_dim: usize,
    pub num_embeddings: Vec<usize>,
    pub pad_id: i64,
    pub token_map: Vec<i64>,
    pub multipliers: Vec<Vec<i64>>,
    pub primes: Vec<Vec<Vec<i64>>>,
    pub offsets: Vec<Vec<i64>>,
    pub scale_block: usize,
    pub scales: Vec<Vec<f32>>,
}

Expand description

The hash tables and geometry, exactly as the loader will read them from the GGUF.

Fields§

§layer_ids: Vec<usize>§max_ngram: usize§n_heads: usize§head_dim: usize§num_embeddings: Vec<usize>§pad_id: i64

token_map[engram_pad_id]: the pad in the COMPRESSED id space.

§token_map: Vec<i64>§multipliers: Vec<Vec<i64>>

[layer][lookback]

§primes: Vec<Vec<Vec<i64>>>

[layer][ngram_size - 2][head]

§offsets: Vec<Vec<i64>>

[layer][(ngram_size - 2) * n_heads + head]

§scale_block: usize

Elements per e8m0 scale block along head_dim.

§scales: Vec<Vec<f32>>

[layer][row * (head_dim / scale_block) + block], each a power of two.

Implementations§

impl EngramTables

pub fn n_hash_cols(&self) -> usize

pub fn from_golden(g: &Golden) -> Self

Auto Trait Implementations§

impl Freeze for EngramTables

impl RefUnwindSafe for EngramTables

impl Send for EngramTables

impl Sync for EngramTables

impl Unpin for EngramTables

impl UnwindSafe for EngramTables

Blanket Implementations§

impl<T> Any for T
where T: 'static + ?Sized,

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more

impl<T> Borrow<T> for T
where T: ?Sized,

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more

impl<T> BorrowMut<T> for T
where T: ?Sized,

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more

impl<T> From<T> for T

fn from(t: T) -> T

Returns the argument unchanged.

impl<T> Instrument for T

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more

impl<T, U> Into<U> for T
where U: From<T>,

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

impl<T, U> TryFrom<U> for T
where U: Into<T>,

type Error = Infallible

The type returned in the event of a conversion error.

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

fn vzip(self) -> V

impl<T> WithSubscriber for T

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,