Home▸Data Science▸Split Conformal Prediction: Finite-Sample Coverage Guarantee and the Calibration Quantile

Split Conformal Prediction: Finite-Sample Coverage Guarantee and the Calibration Quantile

Fit a polynomial, hold out calibration points, take the right order statistic of the absolute residuals and wrap the fit in a prediction band that covers new points at least 1 minus alpha of the time, whatever the model. Change the calibration size, alpha, noise and model degree and compare the guaranteed coverage l/(n+1) with the measured one. A Blender-built plot table with numerical checks of the Beta distribution of coverage built in.

Data Science3DModerate60 FPS📱 Mobile-adapted🟠 Blender⇄ 2D version
Split Conformal Prediction: Finite-Sample Coverage Guarantee and the Calibration Quantile ↗ Open standalone

Fit a polynomial, hold out calibration points, take the right order statistic of the absolute residuals and wrap the fit in a prediction band that covers new points at least 1 minus alpha of the time, whatever the model. Change the calibration size, alpha, noise and model degree and compare the guaranteed coverage l/(n+1) with the measured one. A Blender-built plot table with numerical checks of the Beta distribution of coverage built in.

⚙ Under the hood

Fit a polynomial, hold out calibration points, take the right order statistic of the absolute residuals and wrap the fit in a prediction band that covers new points at least 1 minus alpha of the time, whatever the model. Change the calibration size, alpha, noise and model degree and compare the guaranteed coverage l/(n+1) with the measured one. A Blender-built plot table with numerical checks of the Beta distribution of coverage built in.

Conformal PredictionPrediction IntervalCoverage GuaranteeCalibrationUncertainty

3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)