⛰️ 3D Rotated Quadratic Valley: Momentum, Nesterov and Jacobi Preconditioning versus Condition Number
Four glass marbles race down the same rotated, ill-conditioned valley in 3D: gradient descent, Polyak heavy ball, Nesterov and a diagonal (Jacobi) preconditioned rule. Condition number and valley rotation set the closed-form rates, checked against simulated iteration counts.
⚙ Under the hood
Four glass marbles race down the same rotated, ill-conditioned valley in 3D: gradient descent, Polyak heavy ball, Nesterov and a diagonal (Jacobi) preconditioned rule. Condition number and valley rotation set the closed-form rates, checked against simulated iteration counts.
OptimizationCondition NumberHeavy Ball MomentumNesterov AccelerationPreconditioningGradient DescentConvergence RateMachine Learning
3D · Three.js / WebGL renderer · 60 FPS target · runs fully client-side, no install