Benchmark Contamination Detector (2D)
Interactive 2D lab: watch how leaked benchmark items inflate a model's reported accuracy on a radial similarity plot, and how a decontamination threshold trades detection recall against false positives.
Every benchmark score for a large model carries a hidden question: how much of that score comes from the model actually reasoning, versus having simply seen the answer during pretraining? This 2D simulator makes benchmark contamination physical. A rotating ring of glowing dots represents individual eval questions, each pushed out from the centre by a distance equal to its embedding similarity against the training corpus; a dashed circle is the similarity threshold a decontamination filter would use to flag and discard suspect items before re-scoring. A histogram beneath shows the same similarity distribution split by ground-truth contamination. Dial the true contamination rate, the model's genuine skill, and the detector's threshold, and watch the reported accuracy separate from the decontaminated accuracy in real time — along with the recall/false-positive trade-off that governs every real contamination audit.
Interactive 2D lab: watch leaked benchmark items inflate a model's reported accuracy on a rotating radial similarity plot, and see how a decontamination threshold trades detection recall against false positives.
2D · HTML5 Canvas 2D · 60 FPS target · runs fully client-side, no install