# Measuring Fairness

Measuring Fairness: Measuring Results Group by Group, Fairness Trade-offs.

Updated: November 19, 2026

1. [Measuring Results Group by Group](https://www.ask-codey.com/lessons/ml-fairness-by-group) (Freelancer): One score for everyone hides how a model treats each group, so you split the test rows by group, count each group's own confusion matrix, and compare three rates, the selection rate, the true positive rate and the false positive rate, whose gaps are what Fairlearn's demographic parity and equalized odds ask to be zero.
2. [Fairness Trade-offs](https://www.ask-codey.com/lessons/ml-fairness-tradeoffs) (Freelancer): When two groups have different base rates, a useful screen can't give them equal selection rates and equal error rates at once, and one whose invitations mean the same in both groups can't have equal error rates either unless it makes no mistakes, as Barocas, Hardt and Narayanan, Chouldechova, and Kleinberg, Mullainathan and Raghavan show, so which goal matters is a choice for people, and sometimes the answer is no model.

Source: https://www.ask-codey.com/courses/machine-learning-python/topics/ml-measuring-fairness
