Token
say it: “TOH-kun” /ˈtoʊkən/
A chunk of text, about three-quarters of a word.
What is Token?
A token is a chunk of text a model reads and writes, roughly three-quarters of a word. Models are priced and limited by tokens.
Level: Apprentice · More AI Basics terms at this level
Updated