stream
Core ends each reply on its stop rules and streams it back as it is made.
crit Core
What happens here
- A reply ends on a stop token, a stop string or its output limit.
- Tokens go back as text while they are made, through crit serve's API or to crit-eval.
Learn more
The whole path from prompt to reply.
crit-hub