Think
LLM
Models
Capabilities
Use Cases
Benchmarks
Papers
Glossary
Search
/
Glossary
/
Throughput
Throughput
performance
The number of tokens a model can generate per second, measuring its processing speed.
Learn more on Wikipedia
Throughput — Glossary — ThinkLLM