HomeAI & Machine LearningFairness Metric Trade-off: Equalized Odds vs Calibration

Fairness Metric Trade-off: Equalized Odds vs Calibration

Interactive 3D classifier: adjust per-group decision thresholds on two populations with different base rates and watch demographic parity, equalized odds and calibration gaps move — and see why a single threshold choice can't zero out all three fairness metrics at once.

AI & Machine Learning3DAdvanced60 FPS📱 Mobile-adapted⇄ 2D version
algorithmic-bias-fairness-metric-tradeoff ↗ Open standalone

This simulator makes the algorithmic-fairness impossibility theorem tangible: two synthetic populations, each with its own base rate of true qualification, are scored by the same underlying model and rendered as 440 individually classified points in 3D. Moving each group's decision threshold recomputes the confusion matrix live and reports three standard fairness criteria — demographic parity, equalized odds, and calibration (predictive parity) — so you can watch, in real time, that closing one gap by moving thresholds tends to open another whenever the groups' base rates differ, exactly as proven by Chouldechova (2017) and Kleinberg, Mullainathan & Raghavan (2016).

⚙ Under the hood

Set per-group decision thresholds on two populations with different base rates and watch demographic parity, equalized odds and calibration gaps move in real time -- demonstrating the proven impossibility of zeroing out all three fairness metrics at once.

fairnessalgorithmic biasmachine learningclassificationequalized oddscalibration

3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)