A neural network architecture that uses attention mechanisms to process sequences of data, allowing it to understand relationships between distant elements in the input.