🪟 Sliding-Window Attention with Segment Recurrence: Receptive Field and Cost (2D)
A layer-by-layer influence grid for sliding-window attention with and without Transformer-XL style recurrence, influence-versus-distance and reach-versus-depth plots, Blender-rendered markers, and five independent checks.
⚙ Under the hood
A layer-by-layer influence grid for sliding-window attention with and without Transformer-XL style recurrence, influence-versus-distance and reach-versus-depth plots, Blender-rendered markers, and five independent checks.
Sliding Window AttentionTransformer-XLSegment RecurrenceReceptive FieldLongformerLong ContextAttention CostTransformers
2D · HTML5 Canvas 2D · 60 FPS target · runs fully client-side, no install