HomeData ScienceColumnar Compression: Dictionary & Run-Length Encoding (2D)

Columnar Compression: Dictionary & Run-Length Encoding (2D)

Interactive 2D columnar-storage simulator: watch dictionary encoding and run-length encoding compress a data-warehouse column, with a live column strip, dictionary rack and byte-size comparison chart as row count, cardinality and sort order change.

Data Science2DModerate60 FPS📱 Mobile-adapted⇄ 3D version
2d-ds-topic-100 ↗ Open standalone

Every analytical data warehouse — Snowflake, BigQuery, Redshift, or a raw Parquet file sitting in a data lake — leans on the same two tricks to shrink a column before it ever touches disk: dictionary encoding, which swaps repeated strings for small integer codes, and run-length encoding, which collapses a stretch of identical values into one (value, count) pair. This 2D companion renders the same live data-warehouse column as a flat strip of coloured blocks above a byte-size comparison chart, letting you tune row count, cardinality and how clustered/sorted the values are while raw size, encoded size and compression ratio update from the same formulas real columnar engines use.

⚙ Under the hood

2D columnar-storage simulator: watch dictionary encoding and run-length encoding compress a data-warehouse column on a flat strip chart with a live dictionary rack and a byte-size comparison chart, as row count, cardinality and sort order change.

big datadata warehousecompressioncolumnar storagedata engineeringparquet

2D · HTML5 Canvas 2D · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)