AI Basics vocabulary: Master level

5 AI Basics terms at the Master level, each with a short definition and a link to its full page.

Updated

Study these as flash cards

Attention Mechanism
How a model weighs which tokens matter for the next one.
Mixture of Experts
A model routing each token to a few specialist parts.
Model Distillation
Training a small model to copy a larger one.
Quantization of Models
Shrinking a model by storing weights with fewer bits.
RLHF
Training models on human ratings of their answers.

Every AI Basics term, by level