AI Basics vocabulary: Master level
5 AI Basics terms at the Master level, each with a short definition and a link to its full page.
Updated
- Attention Mechanism
- How a model weighs which tokens matter for the next one.
- Mixture of Experts
- A model routing each token to a few specialist parts.
- Model Distillation
- Training a small model to copy a larger one.
- Quantization of Models
- Shrinking a model by storing weights with fewer bits.
- RLHF
- Training models on human ratings of their answers.