Home▸Information Theory & Coding▸Shannon Entropy: Measuring Information

📶 Shannon Entropy: Measuring Information

Drag symbol probabilities and watch the Shannon entropy H = -Σ p·log2(p) update live, then play out a 20-questions binary search that shows why entropy is the true minimum average bits per symbol.

Information Theory & Coding2DModerate60 FPS

⚙ Under the hood

Drag symbol probabilities and watch Shannon entropy H = -Σ p·log2(p) update live, then play a 20-questions binary search that shows why entropy is the true minimum average bits per symbol.

entropyinformation-theoryprobabilityshannoncoding-theorybits

2D · HTML5 Canvas 2D · 60 FPS target · runs fully client-side, no install