Streaming Responses
say it: “STREE-ming rih-SPON-siz” /ˈstrimɪŋ rɪˈspɑnsɪz/
Sending the answer piece by piece as it is generated.
What is Streaming Responses?
Streaming sends a model's answer token by token as it is generated, so users see text appear right away.
Level: Journeyman · More AI Basics terms at this level
Updated