Click a patch to inspect its attention links.
Clean spacetime signal Noise-dominated patch Selected / attended
⚠ Couldn't load the 3D engineThree.js failed to load from the CDN. Check your connection and reload.

Spacetime Patch Tokenizer: How Sora Turns Video Into Transformer Tokens

Before a video Diffusion Transformer can denoise a clip, the clip has to become a sequence of tokens — and Sora's key architectural idea is to patchify a compressed video latent in space and time at once, producing "spacetime patches" instead of per-frame image patches. This simulator renders that latent volume as a real 3D grid of cuboids: change the latent resolution, clip length, and spatial/temporal patch size to watch the token count N and the O(N²) self-attention cost react live, blend patches toward Gaussian noise to see the tensor a DiT actually denoises at each diffusion timestep, and click any patch to compare full spacetime self-attention (every token sees every other token, the source of temporal coherence) against a cheaper per-frame windowed variant that never looks across time.