📉 Learning Rate Schedules

LR Schedule Types

Constant: Fixed learning rate throughout training

Step Decay: Reduce LR at fixed intervals

Exponential: Gradually decrease LR exponentially

Cosine: Smooth decrease following cosine curve