Attention (mechanism)
Definition: Attention is the mechanism that lets a model weigh how important each word in a sequence is relative to the others, to decide which ones matter most at a given moment.
Rather than treating words in isolation, the model links every element to all the others to capture context. It is the founding idea of Transformers and modern LLMs.