HomeData ScienceLambda Architecture: Batch & Speed Layer Reconciliation

Lambda Architecture: Batch & Speed Layer Reconciliation

Interactive 3D simulator of the Lambda/Kappa big-data architecture: watch events flow through a fast approximate speed layer and a slow exact batch layer, and see how the serving layer reconciles both into one live estimate.

Data Science3DAdvanced60 FPS
ds-topic-14 ↗ Open standalone

Big-data systems answer queries over data that never stops arriving, which forces a tradeoff between latency and exactness. This simulator renders that tradeoff as a live 3D pipeline: events fall down an append-only log, split into a fast speed lane that updates an approximate running estimate on every event, and a slow batch lane that accumulates in a bucket and periodically recomputes an exact aggregate from scratch. A serving-layer podium merges both into a single number using the real reconciliation formula distributed systems use — anchor to the last exact recompute, then add only the delta the fast layer has seen since — with a ghost marker showing the true value so you can watch the error shrink every time a batch fires. A one-click toggle swaps the whole pipeline from Lambda architecture (two separate engines) to Kappa architecture (one stream engine that "recomputes" by replaying the log through itself), showing exactly why Kappa is simpler but never quite as exact.

⚙ Under the hood

An interactive 3D simulator of the Lambda/Kappa big-data architecture: watch events flow through a fast approximate speed layer and a slow exact batch layer, and see how the serving layer reconciles both into one live estimate.

big datadistributed systemslambda architecturekappa architecturestream processingdata engineering

3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)