Definition
An optimization algorithm that updates a model's parameters using the gradient calculated from a small, randomly selected subset (mini-batch) of the total training data.
In short: An optimization algorithm that updates a model's parameters using the gradient calculated from a small, randomly selected subset (mini-batch) of the total training data.