Think
LLM
Models
Capabilities
Use Cases
Benchmarks
Papers
Glossary
Search
/
Dual Averaging — Glossary — ThinkLLM
Glossary
/
Dual Averaging
Dual Averaging
techniques
An optimization method that maintains an average of past gradients to guide updates in a stable way.