crit-hub

router

Each token's routed experts and their weights, for a mixture of experts.

optional

In crit's library

Interface

The methods the engine calls on the slot's plugin, in their host form: token ids, rows of numbers and dicts. Every plugin of the slot has them, which is what lets an ablation switch one for another.

MethodWhat it does
route(...)Each token's experts and weights

Device form: select(logits, top, bias): each token's experts and weights by the host form's rule