Transformer

say it: “trans-FOR-mer” /trænsˈfɔrmər/

The network design behind modern LLMs.

What is Transformer?

The transformer is the neural network design behind modern LLMs, using attention to relate every token to every other.

Level: Freelancer · More AI Basics terms at this level

Updated