Home▸AI & Machine Learning▸LLM Evaluation Gate: Batch Size, Cache Hits and Queue Latency in 3D

🧪 LLM Evaluation Gate: Batch Size, Cache Hits and Queue Latency in 3D

A Blender-built evaluation line where test cases queue on a belt, hit a cache cabinet or wait for a GPU server that processes them in batches: change the batch cap, cache hit rate and shadow traffic and watch latency and GPU cost respond, with five independent numerical checks (M/D/1, Markov chain, utilisation identity, exact batch counts, binomial cache misses).

AI & Machine Learning3DModerate60 FPS📱 Mobile-adapted🟠 Blender⇄ 2D version
LLM Evaluation Gate: Batch Size, Cache Hits and Queue Latency in 3D ↗ Open standalone
⚙ Under the hood

A Blender-built evaluation line where test cases queue on a belt, hit a cache cabinet or wait for a GPU server that processes them in batches: change the batch cap, cache hit rate and shadow traffic and watch latency and GPU cost respond, with five independent numerical checks (M/D/1, Markov chain, utilisation identity, exact batch counts, binomial cache misses).

LLM EvaluationBatchingQueueing TheoryM/D/1 QueueCachingShadow TrafficGPU CostRelease Gate

3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install

What did you find?

Add reproduction steps (optional)