LiveFR

Streaming

Definition: Streaming returns a model's response token by token as it is generated, instead of waiting for the full answer.

The user sees text appear progressively, improving perceived latency. Technically the stream is often delivered via server-sent events.

See also

← Full AI glossary · AI news