HomeComputer ScienceFlaky Test Detector: Sequential Probability Ratio Test

Flaky Test Detector: Sequential Probability Ratio Test

Interactive 3D SPRT simulator: watch a mobile CI test's log-likelihood ratio random-walk between two decision boundaries as it reruns, classifying the test as reliable or flaky without a fixed rerun budget.

Computer Science3DAdvanced60 FPS📱 Mobile-adapted⇄ 2D version
mobile-testing-automation ↗ Open standalone

Mobile CI pipelines rerun failing tests to tell "flaky" from "broken," but a fixed rerun count either wastes runner time on obviously-reliable tests or gives up too early on genuinely intermittent ones. This simulator renders Wald's Sequential Probability Ratio Test as a literal 3D walk: each simulated rerun nudges a log-likelihood-ratio marker up (fail) or down (pass) between a "flaky" ceiling and a "reliable" floor computed from your chosen false-positive and false-negative risk budgets, and the walk stops the instant either boundary is crossed — not after a fixed number of tries. Adjust the hidden true fail probability to see how a genuinely reliable test resolves in a handful of reruns while a borderline-flaky one can wander for dozens, and watch the running average of reruns-to-verdict across repeated trials converge to the theory's expected sample size.

⚙ Under the hood

Watch Wald's Sequential Probability Ratio Test classify a mobile CI test as reliable or flaky in real time: each rerun nudges a 3D log-likelihood-ratio marker toward a decision boundary instead of relying on a fixed rerun count.

test automationflaky testsCI/CDstatisticshypothesis testingmobile QA

3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)