Markov Chain — Glossary — ThinkLLM