Streaming Responses

say it: “STREE-ming rih-SPON-siz” /ˈstrimɪŋ rɪˈspɑnsɪz/

Sending the answer piece by piece as it is generated.

What is Streaming Responses?

Streaming sends a model's answer token by token as it is generated, so users see text appear right away.

Level: Journeyman · More AI Basics terms at this level

Updated