HomeAI & Machine LearningBenchmark Contamination Detector (2D)

Benchmark Contamination Detector (2D)

Interactive 2D lab: watch how leaked benchmark items inflate a model's reported accuracy on a radial similarity plot, and how a decontamination threshold trades detection recall against false positives.

AI & Machine Learning2DModerate60 FPS📱 Mobile-adapted⇄ 3D version
2d-ai-topic-6 ↗ Open standalone

Every benchmark score for a large model carries a hidden question: how much of that score comes from the model actually reasoning, versus having simply seen the answer during pretraining? This 2D simulator makes benchmark contamination physical. A rotating ring of glowing dots represents individual eval questions, each pushed out from the centre by a distance equal to its embedding similarity against the training corpus; a dashed circle is the similarity threshold a decontamination filter would use to flag and discard suspect items before re-scoring. A histogram beneath shows the same similarity distribution split by ground-truth contamination. Dial the true contamination rate, the model's genuine skill, and the detector's threshold, and watch the reported accuracy separate from the decontaminated accuracy in real time — along with the recall/false-positive trade-off that governs every real contamination audit.

⚙ Under the hood

Interactive 2D lab: watch leaked benchmark items inflate a model's reported accuracy on a rotating radial similarity plot, and see how a decontamination threshold trades detection recall against false positives.

LLM evaluationdata leakagebenchmark contaminationembedding similaritymodel evaluation

2D · HTML5 Canvas 2D · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)