Definition
A key component of Transformer models that injects information about the relative or absolute position of tokens in a sequence into the input embeddings.
In short: A key component of Transformer models that injects information about the relative or absolute position of tokens in a sequence into the input embeddings.