Think
LLM
Models
Capabilities
Use Cases
Benchmarks
Papers
Glossary
Search
/
Glossary
/
Attention Head Knockout
Attention Head Knockout
techniques
Disabling individual attention heads to measure their contribution to a model's output or behavior.
Attention Head Knockout — Glossary — ThinkLLM