🔗 Autoregressive Models: Generating Sequences One Token at a Time
A Blender-built 3D workshop of a tiny trained language model: a conveyor of tokens, a lower-triangular causal-mask wall and a bar tower of exact next-token probabilities, with temperature, top-k and top-p sampling, chain-rule log-likelihood and perplexity.
⚙ Under the hood
A Blender-built 3D workshop of a tiny trained language model: a conveyor of tokens, a lower-triangular causal-mask wall and a bar tower of exact next-token probabilities, with temperature, top-k and top-p sampling, chain-rule log-likelihood and perplexity.
autoregressive modelchain rulecausal maskinglanguage modelsequence generationmachine-learning
3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install