🧪 LLM Evaluation Gate: Batch Size, Cache Hits and Queue Latency (2D)
A plan view of the same LLM evaluation gate with Blender-rendered GPU and cache sprites, live queue, and latency and cost curves against batch size from an exact event simulation, with five independent checks.
⚙ Under the hood
A plan view of the same LLM evaluation gate with Blender-rendered GPU and cache sprites, live queue, and latency and cost curves against batch size from an exact event simulation, with five independent checks.
LLM EvaluationBatchingQueueing TheoryM/D/1 QueueCachingShadow TrafficGPU CostRelease Gate
2D · HTML5 Canvas 2D · 60 FPS target · runs fully client-side, no install