Definition
AI models trained using an objective where some tokens in the input text are intentionally hidden (masked), and the model's task is to predict the missing tokens based on their surrounding context.
In short: AI models trained using an objective where some tokens in the input text are intentionally hidden (masked), and the model's task is to predict the missing tokens based on their surrounding context.