Home▸AI & Machine Learning▸Shannon Entropy: Measuring Information

📊 Shannon Entropy: Measuring Information

Drag symbol probabilities and watch the Shannon entropy H = -Σ p·log2(p) update live, then play out a 20-questions binary search that shows why entropy is the true minimum average bits per symbol.

AI & Machine Learning3DAdvanced60 FPS

⚙ Under the hood

Drag symbol probabilities and watch the Shannon entropy H = -Σ p·log2(p) update live, then play out a 20-questions binary search that shows why entropy is the true minimum average bits per symbol.

entropyinformation theoryprobabilitydata analysisalgorithmsstatisticsThree.js

3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install