🧠 Transformer Self-Attention Visualizer
Interactive 3D simulation of transformer self-attention: watch a query token score every key token in embedding space, tune softmax temperature and positional locality bias, and see attention entropy and effective context reach update live.
Computer Science3DModerate60 FPS
⚙ Under the hood
Interactive 3D simulation of transformer self-attention: watch a query token score every key token in embedding space, tune softmax temperature and positional locality bias, and see attention entropy and effective context reach update live.
Three.jstransformerself-attentionllmneural-networkdeep-learning
3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install