crit-hub

stream

Core ends each reply on its stop rules and streams it back as it is made.

crit Core

What happens here

  1. A reply ends on a stop token, a stop string or its output limit.
  2. Tokens go back as text while they are made, through crit serve's API or to crit-eval.

Learn more

The whole path from prompt to reply.