Definition
A machine learning paradigm where the model is trained on data that provides its own supervision signal, typically by predicting a missing or hidden part of the input (e.g., masked words).
In short: A machine learning paradigm where the model is trained on data that provides its own supervision signal, typically by predicting a missing or hidden part of the input (e.