Think
LLM
Models
Capabilities
Use Cases
Benchmarks
Papers
Glossary
Search
/
Glossary
/
Prompt Cache
Prompt Cache
techniques
Cached prefix of a prompt that can be reused across requests to avoid recomputing the same tokens.
Prompt Cache — Glossary — ThinkLLM