Think
LLM
Models
Capabilities
Use Cases
Benchmarks
Papers
Glossary
Search
/
Glossary
/
QK Circuit
QK Circuit
techniques
The query-key component of attention that determines which positions the model attends to.
QK Circuit — Glossary — ThinkLLM