recurrence
The recurrent state of linear-attention layers such as gated delta, per sequence, with its prompt prefill. A hybrid model's plugin requires it.
optional
In crit's library
Gated-delta recurrenceThe gated-delta recurrence token by token, keeping every state, with long prompt rows through a chunked kernel.recurrenceRecurrent state recoveryA recurrent layer mixes every token into one state, so after a speculative round the engine rebuilds that state for exactly the accepted tokens instead of dropping rejected rows.recurrence
Interface
The methods the engine calls on the slot's plugin, in their host form: token ids, rows of numbers and dicts. Every plugin of the slot has them, which is what lets an ablation switch one for another.
| Method | What it does |
|---|---|
prefill(...) | A prompt chunk through the recurrence, keeping each state the round needs |
Device form: pool(...) with open, fork, accept; forward(layer, query, key, value, log_decay, beta, pool, batch)
crit-hub