HomeComputer ScienceFlaky Test Detector 2D: Sequential Probability Ratio Test

Flaky Test Detector 2D: Sequential Probability Ratio Test

Interactive 2D SPRT dashboard: watch a mobile CI test's log-likelihood-ratio walk drift between a flaky ceiling and a reliable floor as it reruns, with a live histogram of reruns-to-verdict across repeated trials and a draggable, zoomable walk chart.

Computer Science2DAdvanced60 FPS📱 Mobile-adapted⇄ 3D version
2d-mobile-testing-automation ↗ Open standalone

Mobile CI pipelines rerun failing tests to tell "flaky" from "broken," but a fixed rerun count either wastes runner time on obviously-reliable tests or gives up too early on genuinely intermittent ones. This dashboard renders Wald's Sequential Probability Ratio Test as a 2D log-likelihood-ratio walk chart: each simulated rerun nudges a marker up (fail) or down (pass) between a "flaky" ceiling and a "reliable" floor computed from your chosen false-positive and false-negative risk budgets, and the walk stops the instant either boundary is crossed — not after a fixed number of tries. A second panel tracks a live histogram of reruns-to-verdict across repeated trials, colored by outcome, so you can watch the distribution the theory predicts take shape. Adjust the hidden true fail probability to see how a genuinely reliable test resolves in a handful of reruns while a borderline-flaky one can wander for dozens.

⚙ Under the hood

Interactive 2D SPRT dashboard: watch a mobile CI test's log-likelihood-ratio walk drift between a flaky ceiling and a reliable floor as it reruns, with a live histogram of reruns-to-verdict across repeated trials and a draggable, zoomable walk chart.

test automationflaky testsCI/CDstatisticshypothesis testingmobile QA

2D · HTML5 Canvas 2D · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)