Home▸AI & Machine Learning▸Test Suite Flakiness, Retries and Defect Discovery: 2D Coverage Map

Test Suite Flakiness, Retries and Defect Discovery: 2D Coverage Map

Top-down map of 200 code units with the sweeping test run, defects caught per run and the expected cumulative discovery curve, using the same probability model and numerical checks as the 3D lab.

AI & Machine Learning2DModerate60 FPS📱 Mobile-adapted🟠 Blender⇄ 3D version
Test Suite Flakiness, Retries and Defect Discovery: 2D Coverage Map ↗ Open standalone

This simulation demonstrates the principles of automation testing in a CI/CD pipeline: a fixed-size test suite is distributed across a configurable number of parallel runner lanes, each pulling the next queued test the moment it becomes free. A per-test flakiness rate drives a real retry-on-failure policy — a test that fails once is retried automatically, and only a test that fails on both attempts is recorded as a final failure — the same mechanism used by real CI systems to keep transient flakes from blocking a build. Live readouts track completion progress, pass rate, retries consumed, measured throughput, and an estimated time remaining derived from the pipeline's own observed speed, showing directly how parallelism and reliability trade off in an automated test infrastructure.

⚙ Under the hood

Top-down map of 200 code units with the sweeping test run, defects caught per run and the expected cumulative discovery curve, using the same probability model and numerical checks as the 3D lab.

Software TestingFlaky TestsTest CoverageDefect DiscoveryMonte Carlo

2D · HTML5 Canvas 2D · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)