Home▸Data Science▸Probability Calibration — Reliability Diagrams & Brier Score

Probability Calibration — Reliability Diagrams & Brier Score

Interactive 3D reliability-diagram simulator: generate a synthetic classifier's predicted probabilities, dial in over/under-confidence, and watch Platt scaling and isotonic regression pull the calibration bars onto the perfect-calibration diagonal while Brier score, ECE and MCE update live.

Data Science3DAdvanced60 FPS

A classifier that says "80% confident" should be right about 80% of the time — most aren't. This simulator generates a synthetic classifier's predicted probabilities from a controllable confidence slope, renders a real 3D reliability diagram (confidence bars vs. accuracy bars against the perfect-calibration diagonal), and lets you apply Platt scaling or isotonic regression to recalibrate it, watching Brier score, Expected Calibration Error and Maximum Calibration Error update live as the bars move.

⚙ Under the hood

Generate a synthetic classifier's predicted probabilities, dial in over- or under-confidence, and watch Platt scaling and isotonic regression pull a live 3D reliability diagram onto the perfect-calibration diagonal while Brier score, ECE and MCE update in real time.

calibrationreliability-diagrambrier-scoreplatt-scalingisotonic-regressionmachine-learning

3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install