⛰️ Heavy-Ball Momentum Lab: Spectral Radius on an Ill-Conditioned Valley
Gradient descent versus heavy-ball momentum on a quadratic valley with condition number kappa: exact spectral radius from the characteristic polynomial, Polyak optimal step and momentum, stability boundary alpha < 2(1+beta), iterations to converge growing like kappa versus sqrt(kappa). Blender-built balls, plinth and flag.
⚙ Under the hood
Gradient descent versus heavy-ball momentum on a quadratic valley with condition number kappa: exact spectral radius from the characteristic polynomial, Polyak optimal step and momentum, stability boundary alpha < 2(1+beta), iterations to converge growing like kappa versus sqrt(kappa). Blender-built balls, plinth and flag.
gradient descentmomentumheavy ballcondition numberspectral radiusoptimizationquadraticBlender
3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install