Home▸Machine Learning & Neural Networks▸Autoregressive Models: Generating Sequences One Token at a Time — 2D Attention Map

🔗 Autoregressive Models: Generating Sequences One Token at a Time — 2D Attention Map

2D companion of the autoregressive sequence lab: the same trained model drawn as a token strip, a causal attention matrix and horizontal probability bars, with exact softmax, temperature, top-k and top-p sampling, log-likelihood and perplexity.

Machine Learning & Neural Networks2DModerate60 FPS📱 Mobile-adapted🟠 Blender⇄ 3D version
Autoregressive Models: Generating Sequences One Token at a Time — 2D Attention Map ↗ Open standalone
⚙ Under the hood

2D companion of the autoregressive sequence lab: the same trained model drawn as a token strip, a causal attention matrix and horizontal probability bars, with exact softmax, temperature, top-k and top-p sampling, log-likelihood and perplexity.

autoregressive modelchain rulecausal maskinglanguage modelnext-token samplingmachine-learning

2D · HTML5 Canvas 2D · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)