Definition
A training technique where the initial learning rate is gradually reduced over time or after a certain number of training steps, allowing for finer tuning of the model parameters later in training.
In short: A training technique where the initial learning rate is gradually reduced over time or after a certain number of training steps, allowing for finer tuning of the model parameters later in training.