Token

say it: “TOH-kun” /ˈtoʊkən/

A chunk of text, about three-quarters of a word.

What is Token?

A token is a chunk of text a model reads and writes, roughly three-quarters of a word. Models are priced and limited by tokens.

Level: Apprentice · More AI Basics terms at this level

Updated