Home▸AI & Machine Learning▸Sliding-Window Attention with Segment Recurrence: Receptive Field and Cost (2D)

🪟 Sliding-Window Attention with Segment Recurrence: Receptive Field and Cost (2D)

A layer-by-layer influence grid for sliding-window attention with and without Transformer-XL style recurrence, influence-versus-distance and reach-versus-depth plots, Blender-rendered markers, and five independent checks.

AI & Machine Learning2DModerate60 FPS📱 Mobile-adapted🟠 Blender⇄ 3D version
Sliding-Window Attention with Segment Recurrence: Receptive Field and Cost (2D) ↗ Open standalone
⚙ Under the hood

A layer-by-layer influence grid for sliding-window attention with and without Transformer-XL style recurrence, influence-versus-distance and reach-versus-depth plots, Blender-rendered markers, and five independent checks.

Sliding Window AttentionTransformer-XLSegment RecurrenceReceptive FieldLongformerLong ContextAttention CostTransformers

2D · HTML5 Canvas 2D · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)