Stemming vs Lemmatization: Rule-Based Suffix Stripping
Watch the Porter stemming algorithm strip suffixes off a word letter by letter — with the vowel/consonant 'measure' m computed live — and compare it against dictionary-based lemmatization in an interactive 3D letter-block simulator.
Before a language model ever sees a probability or an embedding, raw text usually passes through a normalization step that collapses inflected forms — "running", "runs", "ran" — toward a single root. This simulator renders a word as a row of 3D letter tiles, color-coded vowel vs. consonant, and steps through the real Porter stemming algorithm's suffix-stripping rules live, computing the vowel-consonant "measure" m that gates each rule exactly as the 1980 algorithm specifies. A dictionary-based lemmatizer mode runs the same words through a lookup table instead, so you can watch the two normalization strategies diverge — the stemmer's fast rule-chopping versus the lemmatizer's slower but always-valid dictionary answer.
Step through the real Porter stemming algorithm as it strips suffixes off a word and computes its vowel-consonant "measure" m live, then compare the result against dictionary-based lemmatization in an interactive 3D letter-block simulator.
3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install