Think
LLM
Models
Capabilities
Use Cases
Benchmarks
Papers
Glossary
Search
/
Glossary
/
Inference Infrastructure
Inference Infrastructure
deployment
The software and hardware systems that run a trained model to generate predictions or outputs.
Inference Infrastructure — Glossary — ThinkLLM