📡 Information Theory & Coding

Huffman CodingNewBuild an optimal prefix-free code by merging the two rarest symbols again and again. Watch… Hamming CodesFlip a bit in a Hamming-encoded word and watch the parity checks produce a syndrome that… LZ77 CompressionNewWatch the LZ77 sliding-window compression algorithm encode data by finding repeated patterns. SVD CompressionNewKeep only the top k singular values of an image and watch how few rank-1 layers are needed… DCT Image Compression (JPEG Principle)NewDiscrete Cosine Transform compresses an 8×8 pixel block like JPEG. DCT-II: X_k =… Shannon Entropy: Measuring InformationNewDrag symbol probabilities and watch Shannon entropy H = -Σ p·log2(p) update live, then play… Channel Capacity: The Shannon-Hartley TheoremNewAdjust bandwidth and signal-to-noise ratio to watch the Shannon-Hartley channel capacity C =… Mutual Information: Shared Information Between VariablesNewEdit a joint probability table live and watch H(X), H(Y), joint entropy and mutual… Kolmogorov Complexity: The Shortest DescriptionNewCompress a bit-string live with a real LZ77-style algorithm and use the compressed length as…