crit-hub

recurrence

The recurrent state of linear-attention layers such as gated delta, per sequence, with its prompt prefill. A hybrid model's plugin requires it.

optional

In crit's library

Interface

The methods the engine calls on the slot's plugin, in their host form: token ids, rows of numbers and dicts. Every plugin of the slot has them, which is what lets an ablation switch one for another.

MethodWhat it does
prefill(...)A prompt chunk through the recurrence, keeping each state the round needs

Device form: pool(...) with open, fork, accept; forward(layer, query, key, value, log_decay, beta, pool, batch)