Think
LLM
Models
Capabilities
Use Cases
Benchmarks
Papers
Glossary
Search
/
Glossary
/
On-Policy Self-Distillation
On-Policy Self-Distillation
techniques
Training a model to match its own high-quality outputs generated through sampling or search.
On-Policy Self-Distillation — Glossary — ThinkLLM