pub struct AttnWeights<'a> {
pub sink: &'a [f32],
pub wq_a: &'a [f32],
pub q_norm: &'a [f32],
pub wq_b: &'a [f32],
pub wkv: &'a [f32],
pub kv_norm: &'a [f32],
pub wo_a: &'a [f32],
pub wo_b: &'a [f32],
}Expand description
The layer’s parameters, all bf16 values except the f32 sink. Shapes as nn.Linear stores
them ([out, in]).
Fields§
§sink: &'a [f32]§wq_a: &'a [f32]§q_norm: &'a [f32]§wq_b: &'a [f32]§wkv: &'a [f32]§kv_norm: &'a [f32]§wo_a: &'a [f32]§wo_b: &'a [f32]Auto Trait Implementations§
impl<'a> Freeze for AttnWeights<'a>
impl<'a> RefUnwindSafe for AttnWeights<'a>
impl<'a> Send for AttnWeights<'a>
impl<'a> Sync for AttnWeights<'a>
impl<'a> Unpin for AttnWeights<'a>
impl<'a> UnwindSafe for AttnWeights<'a>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more