HomeAlgorithms & AIAttention Mechanism Explorer

🧠 Attention Mechanism Explorer

Watch a Transformer-style attention layer compute softmax attention weights between tokens in real time — tune token count, temperature and attention heads and see which tokens each query attends to.

Algorithms & AI3DModerate60 FPS
attention-mechanisms ↗ Open standalone
⚙ Under the hood

Watch a Transformer-style attention layer compute softmax attention weights between tokens in real time — tune token count, temperature and attention heads and see which tokens each query attends to.

Three.jsAIMachine LearningNeural NetworksAlgorithmsTransformers

3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)