Models Capabilities Use Cases Benchmarks Papers Glossary

Models Capabilities Use Cases Benchmarks Papers Glossary

About Privacy Terms RSS

ThinkLLM

Spot an error in our data? Let us know.

Glossary/Hybrid Attention Architecture

Hybrid Attention Architecture

techniques

An LLM design combining softmax attention layers with linear-attention layers to balance expressiveness and efficiency.

Hybrid Attention Architecture — Glossary — ThinkLLM