Definition
A simple and effective data compression algorithm used in language models to create a vocabulary of subword units by iteratively merging the most frequent adjacent pairs of characters or bytes.
In short: A simple and effective data compression algorithm used in language models to create a vocabulary of subword units by iteratively merging the most frequent adjacent pairs of characters or bytes.