Information-Theoretic Bounds — Glossary — ThinkLLM