Object actually present Object absent (phantom) Patch evidence (image grid)
⚠ Couldn't load the 3D engineThree.js failed to load from the CDN. Check your connection and reload.

VLM Object Hallucination Lab

Vision-language models like GPT-4V, Gemini Vision, LLaVA and Florence-2 caption images by blending two signals at every generated word: real visual evidence from the image encoder, and a language prior learned from co-occurrence statistics in training captions. This simulator renders an actual 3D scene — a kitchen table, an office desk, or a beach — with a real subset of objects placed in it, then generates a caption for that scene word by word using a live softmax over both signals. Push the language-prior weight or the occlusion/noise slider up and watch strongly-associated objects (a knife next to a fork, a mouse next to a laptop) get named even when they were never placed in the scene — a hallucinated mention, tracked live by the same CHAIRi metric researchers use to benchmark real VLMs.