Base-Rate Fairness Impossibility: Confusion Cells of Two Groups (2D)
Six bars of TPR, FPR and PPV for groups A and B, two blocks of dots coloured by confusion cell and a plot of the second group's outcome against its base rate. The same shared model as the 3D scene with numerical checks.
A machine learning classifier scores two demographic groups using exactly the same underlying risk model — yet the groups have different true base rates for the outcome being predicted. This simulator renders both populations as 3D point clouds along a shared score axis and lets you set each group's base rate and the decision threshold(s), then watches equalized-odds metrics (FPR, TPR) and the calibration metric (PPV) update live. The result reproduces a real mathematical fact known as the fairness impossibility theorem: when base rates differ, equal accuracy across groups and equal calibration across groups cannot both hold at once, except in the trivial case where the base rates already match.
Six bars of TPR, FPR and PPV for groups A and B, two blocks of dots coloured by confusion cell and a plot of the second group's outcome against its base rate. The same shared model as the 3D scene with numerical checks.
2D · HTML5 Canvas 2D · 60 FPS target · runs fully client-side, no install