crit-hub

expert_residency

Which experts stay on the device and which are fetched or computed elsewhere, under a cache policy.

optionalhost policy

In crit's library

Interface

The methods the engine calls on the slot's plugin, in their host form: token ids, rows of numbers and dicts. Every plugin of the slot has them, which is what lets an ablation switch one for another.

MethodWhat it does
plan(...)Which experts the device holds
resident(...)Whether an expert is on the device now