Think
LLM
Models
Capabilities
Use Cases
Benchmarks
Papers
Glossary
Search
/
Glossary
/
Teacher distillation
Teacher distillation
techniques
Using outputs from a larger or better model to train a smaller model to replicate its behavior.
Teacher distillation — Glossary — ThinkLLM