Home▸Data Science▸Columnar Storage and Zone-Map Predicate Pushdown: Bytes Saved by Layout and Clustering

Columnar Storage and Zone-Map Predicate Pushdown: Bytes Saved by Layout and Clustering

Compare a row store, a column store and a column store with min/max zone-map predicate pushdown on a query that reads a few columns and filters on one. Change table width, columns referenced, predicate selectivity, row-group size, clustering and compression to see bytes read and the fraction of row groups skipped, checked against brute-force row-group simulation. A Blender-built data bench with bars and groups.

Data Science3DModerate60 FPS📱 Mobile-adapted🟠 Blender⚡ Plasma⇄ 2D version
Columnar Storage and Zone-Map Predicate Pushdown: Bytes Saved by Layout and Clustering ↗ Open standalone

Every column-oriented file format at the heart of the Big Data stack — Parquet and ORC, read by Spark SQL, Hive and Presto on top of HDFS — makes two bets: store each column contiguously so a query only pays for the columns it touches, and keep a small min/max "zone map" per row group so whole chunks of the table can be skipped without ever being read. This simulator renders a real 48-row table as a 3D grid of cells split into row groups, lets you flip between row-major and columnar layout, turn dictionary encoding on or off, change how many row groups the table is split into, and slide a range query on the sorted id column — with live readouts for the compression ratio, the bytes actually scanned, and how many row groups survive the zone-map prune.

⚙ Under the hood

Compare a row store, a column store and a column store with min/max zone-map predicate pushdown on a query that reads a few columns and filters on one. Change table width, columns referenced, predicate selectivity, row-group size, clustering and compression to see bytes read and the fraction of row groups skipped, checked against brute-force row-group simulation. A Blender-built data bench with bars and groups.

big datacolumnar storageparquetsparkdictionary encodingpredicate pushdownColumnar StorageParquetPredicate PushdownZone MapsData Engineering

3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)