Struct VerifyBatchedOpts 

pub struct VerifyBatchedOpts {
    pub write_on_accept: bool,
}

One beam-search request for a translation model (NLLB). Carries the resolved per-request parameters the scheduler stamps onto the sequence; the model runs the whole beam search to completion and returns the winning hypothesis. Per-call options for Model::decode_verify_batched.

Fields

write_on_accept: bool

Ask the GDN layers for the write-on-accept K=4 verify. The caller commits to running Model::gdn_fold_accepted with every verdict before its commit_accepted_prefix calls. Off by default so a caller that commits through another path (the MTP batched K-row verify) never reaches a state the layer wrote nothing for.

Trait Implementations

impl Clone for VerifyBatchedOpts

fn clone(&self) -> VerifyBatchedOpts

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for VerifyBatchedOpts

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for VerifyBatchedOpts

fn default() -> VerifyBatchedOpts

Returns the “default value” for a type.

impl PartialEq for VerifyBatchedOpts

fn eq(&self, other: &VerifyBatchedOpts) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for VerifyBatchedOpts

impl Eq for VerifyBatchedOpts

impl StructuralPartialEq for VerifyBatchedOpts