HomeComputer ScienceTransformer Self-Attention Visualizer

🧠 Transformer Self-Attention Visualizer

Interactive 3D simulation of transformer self-attention: watch a query token score every key token in embedding space, tune softmax temperature and positional locality bias, and see attention entropy and effective context reach update live.

Computer Science3DModerate60 FPS
artificial-intelligence-advanced ↗ Open standalone
⚙ Under the hood

Interactive 3D simulation of transformer self-attention: watch a query token score every key token in embedding space, tune softmax temperature and positional locality bias, and see attention entropy and effective context reach update live.

Three.jstransformerself-attentionllmneural-networkdeep-learning

3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)