VISION OCCLUDED
True object pose Vision estimate Tactile estimate Fused estimate (gripper target)
⚠ Couldn't load the 3D engineThree.js failed to load from the CDN. Check your connection and reload.

Vision-Tactile Fusion for Grasping

A robot gripper must find an object it cannot yet touch. An overhead camera gives a continuous but noisy, occasionally-occluded, possibly-miscalibrated position estimate; a tactile sensor on the fingertip gives a precise estimate the instant it makes contact, but is blind until then. This simulator runs a full sense-approach-contact-grasp cycle and fuses both estimates by inverse-variance weighting, so you can compare a fused strategy against relying on either sensor alone and watch how grasp success rate responds to noise, calibration bias and occlusion.