HomeSociety & EconomicsCalibrating Forecasts

3D Forecaster Reliability Diagram

3D reliability-diagram simulator: stated-confidence bins rise as bars against a perfect-calibration reference plane, revealing whether a forecaster with adjustable overconfidence is really right as often as they claim.

Society & Economics3DEasy60 FPS📱 Mobile-adapted⇄ 2D version
3d-ufo-experts-pollution ↗ Open standalone

A reliability diagram is the classic tool forecasting scientists use to audit a single forecaster's track record: bucket every prediction by its stated confidence, then check whether the real hit rate in each bucket matches the promise. This simulator renders that diagram in 3D — ten bars rising from a grid, one per confidence bin, their height set by live Bernoulli-trial outcomes — next to a translucent diagonal plane marking perfect calibration. Drag the overconfidence bias slider and watch the tall, high-confidence bars pull away from the plane as the forecaster's stated certainty stops matching reality, while the Brier score and expected calibration error quantify the gap numerically.

⚙ Under the hood

Manipulate the reliability diagram to align confidence bins with the perfect calibration plane.

forecastingcalibrationconfidence

3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)