crit-hub

drafter

Proposes the draft tokens a speculative round verifies: a chain or a tree, from the model's draft head, the prompt or a published drafter.

optionalhost policy

In crit's library

Interface

The methods the engine calls on the slot's plugin, in their host form: token ids, rows of numbers and dicts. Every plugin of the slot has them, which is what lets an ablation switch one for another.

MethodWhat it does
start(sequence, tokens)A sequence's tokens so far
propose(sequence, width)The draft tree to verify: tokens, parents, laws
observe(sequence, emitted)What the round emitted
release(sequence)The sequence ended