Definition
A method of training large AI models by utilizing multiple machines, processors, or GPUs simultaneously, significantly reducing the time required for computation.
In short: A method of training large AI models by utilizing multiple machines, processors, or GPUs simultaneously, significantly reducing the time required for computation.