This 2D pipeline runs the same real front-end classical speech-recognition acoustic models use, but the voice itself is synthesized differently from a 3D scan-line terrain: instead of shaping frequency-domain harmonics analytically, this version drives an actual time-domain source-filter model — a leaky-integrated glottal pulse train excites a parallel bank of three second-order IIR resonators, one per vowel formant, exactly the classic formant-synthesizer architecture:
glottal[n] = leaky-integrated impulse train at F0
formant_i: y[n] = b0·x[n] + a1·y[n−1] + a2·y[n−2]
a1 = 2r·cos(θ), a2 = −r², r = e^(−πB/fs), θ = 2πF/fs
voice[n] = Σ_i gain_i · y_i[n] (i = F1, F2, F3)
That filtered voice then runs through the standard MFCC front end — pre-emphasis, a Hamming window, a direct DFT power spectrum, a mel-scaled triangular filterbank (built with continuous per-bin interpolation rather than snapping edges to the nearest DFT bin), log compression, and a DCT-II — exactly the six steps a real acoustic model consumes.
- Top strip — a scrolling mel-spectrogram heatmap: each column is one analysis frame, each row one mel filter, brightness is log filterbank energy.
- Middle strip — the current frame's raw DFT power-spectrum curve with the mel triangular filters drawn underneath it, so you can see exactly which filters are catching which part of the spectrum.
- Bottom strip — the 13 MFCC coefficients for the newest frame, the actual feature vector a real ASR acoustic model would receive.
- /a/ /i/ /u/ — switches the three target formant frequencies (F1/F2/F3) the resonator bank is tuned to.
- Pitch F0 — the glottal pulse-train rate; changes harmonic spacing of the source, not the resonator (formant) frequencies.
- Background noise — mixes broadband noise into the source signal, flattening the mel-energy terrain and shrinking |c₁|, exactly how real noise erodes ASR accuracy.
- Mel filterbank size — how many triangular filters (12–40) partition the spectrum; the spectrogram rows and the overlaid triangles both track this exactly.
Real-world relevance: this is still the same MFCC feature extractor used as the input stage of classical HMM-GMM recognizers and many modern acoustic models' front ends — only the synthetic voice generator underneath is a genuine recursive digital filter, not a frequency-domain shortcut.