router
Each token's routed experts and their weights, for a mixture of experts.
optional
In crit's library
Interface
The methods the engine calls on the slot's plugin, in their host form: token ids, rows of numbers and dicts. Every plugin of the slot has them, which is what lets an ablation switch one for another.
| Method | What it does |
|---|---|
route(...) | Each token's experts and weights |
Device form: select(logits, top, bias): each token's experts and weights by the host form's rule
crit-hub