Home▸Machine Learning & Neural Networks▸Autoregressive Models: Generating Sequences One Token at a Time

🔗 Autoregressive Models: Generating Sequences One Token at a Time

A Blender-built 3D workshop of a tiny trained language model: a conveyor of tokens, a lower-triangular causal-mask wall and a bar tower of exact next-token probabilities, with temperature, top-k and top-p sampling, chain-rule log-likelihood and perplexity.

Machine Learning & Neural Networks3DModerate60 FPS📱 Mobile-adapted🟠 Blender⇄ 2D version
Autoregressive Models: Generating Sequences One Token at a Time ↗ Open standalone
⚙ Under the hood

A Blender-built 3D workshop of a tiny trained language model: a conveyor of tokens, a lower-triangular causal-mask wall and a bar tower of exact next-token probabilities, with temperature, top-k and top-p sampling, chain-rule log-likelihood and perplexity.

autoregressive modelchain rulecausal maskinglanguage modelsequence generationmachine-learning

3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)