← 🧠 Machine Learning

🐞 HPO Debug Lab

Step: 0
Loss:
Grad norm:
Status: OK
FPS:
Drag — rotate · Scroll — zoom

🐞 Error Handling and Debugging in Hyperparameter Optimization

An optimizer ball descends a 3D loss landscape while a live debug console reports step, loss, gradient norm, and status — so you can trigger, watch, and fix the training failures that hyperparameter sweeps commonly hit.

🔬 What It Demonstrates

Gradient descent on a bumpy multi-minima surface behaves very differently depending on learning rate, gradient clipping, and batch noise — exactly the levers that separate a healthy run from a diverging, stalled, or NaN-producing one.

🎮 How to Use

Pick a failure mode to inject a specific bug, watch the console log warnings and errors as they happen, then toggle gradient clipping or adjust the learning rate live to see whether the run recovers.

💡 Did You Know?

NaN loss during real training is most often traced to an unclipped gradient spike or a learning rate set too high — gradient clipping remains the single most common one-line fix in practice.