Think
LLM
Models
Capabilities
Use Cases
Benchmarks
Papers
Glossary
Search
/
Glossary
/
Global Attention
Global Attention
techniques
Attention mechanism where each token can attend to all preceding tokens in the sequence.
Global Attention — Glossary — ThinkLLM