Home▸Data Science▸Columnar Storage and Zone-Map Predicate Pushdown: Row Groups Skipped (2D)

Columnar Storage and Zone-Map Predicate Pushdown: Row Groups Skipped (2D)

Bar chart of bytes read by row store, columnar and pushdown, a grid of row groups coloured skipped or read, and the skip fraction versus clustering. The same shared model as the 3D scene with numerical checks.

Data Science2DModerate60 FPS📱 Mobile-adapted🟠 Blender⚡ Plasma⇄ 3D version
Columnar Storage and Zone-Map Predicate Pushdown: Row Groups Skipped (2D) ↗ Open standalone

Every column-oriented file format at the heart of the Big Data stack — Parquet and ORC, read by Spark SQL, Hive and Presto on top of HDFS — makes two bets: store each column contiguously so a query only pays for the columns it touches, and keep a small min/max "zone map" per row group so whole chunks of the table can be skipped without ever being read. This simulator renders a real 48-row table as a 3D grid of cells split into row groups, lets you flip between row-major and columnar layout, turn dictionary encoding on or off, change how many row groups the table is split into, and slide a range query on the sorted id column — with live readouts for the compression ratio, the bytes actually scanned, and how many row groups survive the zone-map prune.

⚙ Under the hood

Bar chart of bytes read by row store, columnar and pushdown, a grid of row groups coloured skipped or read, and the skip fraction versus clustering. The same shared model as the 3D scene with numerical checks.

Columnar StorageParquetPredicate PushdownZone MapsData Engineering

2D · HTML5 Canvas 2D · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)