Definition
A powerful neural network architecture, foundational to modern LLMs, that relies entirely on self-attention mechanisms to weigh the importance of different parts of the input sequence.
In short: A powerful neural network architecture, foundational to modern LLMs, that relies entirely on self-attention mechanisms to weigh the importance of different parts of the input sequence.