crit-hub

projections

Every matrix multiply of the model: weights loaded in the format they are stored in, decode rows through a GEMV and prompt rows through a GEMM, each row's bits the same alone and batched.

required

In crit's library

Interface

The methods the engine calls on the slot's plugin, in their host form: token ids, rows of numbers and dicts. Every plugin of the slot has them, which is what lets an ablation switch one for another.

MethodWhat it does
prepare(...)A matrix in its stored format
project(...)Rows times a matrix
dense(...)The dense reference product

Device form: load(tensors, format, role) and matmul(x, matrix), each row's bits those of the row alone in a call of up to 8 rows