expert_source
Where expert weights come from: held in memory, or read from a file on demand behind a host tier.
optionalhost policy
In crit's library
Expert weights in memoryExpert weights are held in memory as the checkpoint gives them. The plain source every other expert source is compared with.expert_sourceFile-backed experts with read-aheadExpert weights stay in a file on disk instead of memory: each expert is read as an exact, checked byte range, and the ones a predictor expects are read ahead.expert_source
Interface
The methods the engine calls on the slot's plugin, in their host form: token ids, rows of numbers and dicts. Every plugin of the slot has them, which is what lets an ablation switch one for another.
| Method | What it does |
|---|---|
add(...) | An expert's tensors |
matrices(...) | An expert's matrices, from memory or file |
crit-hub