Definition
Root Mean Square Propagation: An adaptive learning rate optimization algorithm that divides the learning rate by an exponentially decaying average of the squared gradients.
In short: Root Mean Square Propagation: An adaptive learning rate optimization algorithm that divides the learning rate by an exponentially decaying average of the squared gradients.