HomeCybersecuritySIEM Log Ingestion Pipeline: Queueing & Storage-Tier Aging

SIEM Log Ingestion Pipeline: Queueing & Storage-Tier Aging

Interactive 3D SIEM ingestion pipeline: tune log ingestion rate against parser throughput to trigger queue backpressure and dropped events, then watch processed events age from hot to warm to cold storage tiers under a live retention policy.

Cybersecurity3DModerate60 FPS
siem-platforms ↗ Open standalone

Every SIEM platform is built on a queueing problem before it is a detection problem: log events stream in from hosts at some ingestion rate, a parsing/normalization stage can only drain that queue so fast, and once the buffer fills, events start getting dropped rather than analyzed. This simulator renders that pipeline in 3D — six host sources feed events into a live queue in front of a parser gate, and tuning the ingestion rate against the parser throughput shows the backlog and drop counter respond exactly as the λ vs. μ queueing model predicts. Events that clear the parser don't just disappear into a database; they fly into a hot storage zone and age through warm and cold tiers on a retention timer you control, live readouts track ingest/parse EPS, buffer backlog and drops, and a collapsible section spells out the underlying queueing and retention formulas.

⚙ Under the hood

Tune a SIEM ingestion rate against parser throughput to trigger queue backpressure and dropped events, then watch processed events age from hot to warm to cold storage tiers under a live retention policy.

siemcybersecurityqueueing-theorylog-managementsocdata-retention

3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)