Home▸AI & Machine Learning▸3D LLM Judge Position Bias: Probit Choice Model, Swap Consistency and Order-Averaged Debiasing

⚖️ 3D LLM Judge Position Bias: Probit Choice Model, Swap Consistency and Order-Averaged Debiasing

A Blender-built balance scale tilts toward the slot a noisy, biased judge prefers while trays collect the verdicts of a Monte Carlo benchmark: accuracy of fixed, random and order-averaged judging against closed forms for the probit model, with five independent checks.

AI & Machine Learning3DModerate60 FPS📱 Mobile-adapted🟠 Blender⇄ 2D version
3D LLM Judge Position Bias: Probit Choice Model, Swap Consistency and Order-Averaged Debiasing ↗ Open standalone
⚙ Under the hood

A Blender-built balance scale tilts toward the slot a noisy, biased judge prefers while trays collect the verdicts of a Monte Carlo benchmark: accuracy of fixed, random and order-averaged judging against closed forms for the probit model, with five independent checks.

LLM-as-a-JudgePosition BiasEvaluationProbit ModelSwap ConsistencyDebiasingMonte CarloBenchmarks

3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)