AI Basics flash cards: Master level

5 AI Basics terms at the Master level, as flash cards.

Updated

Terms in this deck

Attention Mechanism
How a model weighs which tokens matter for the next one.
Mixture of Experts
A model routing each token to a few specialist parts.
Model Distillation
Training a small model to copy a larger one.
Quantization of Models
Shrinking a model by storing weights with fewer bits.
RLHF
Training models on human ratings of their answers.

Read them in the glossary