🔗 Autoregressive Models: Generating Sequences One Token at a Time — 2D Attention Map
2D companion of the autoregressive sequence lab: the same trained model drawn as a token strip, a causal attention matrix and horizontal probability bars, with exact softmax, temperature, top-k and top-p sampling, log-likelihood and perplexity.
⚙ Under the hood
2D companion of the autoregressive sequence lab: the same trained model drawn as a token strip, a causal attention matrix and horizontal probability bars, with exact softmax, temperature, top-k and top-p sampling, log-likelihood and perplexity.
autoregressive modelchain rulecausal maskinglanguage modelnext-token samplingmachine-learning
2D · HTML5 Canvas 2D · 60 FPS target · runs fully client-side, no install