Definition
An iterative optimization algorithm used to minimize a function (such as a model's loss function) by repeatedly moving in the direction of the steepest descent, which is the negative of the gradient.
In short: An iterative optimization algorithm used to minimize a function (such as a model's loss function) by repeatedly moving in the direction of the steepest descent, which is the negative of the gradient.