LLMs encode goals in sparse attention heads and pursue them by repeatedly re-reading task specifications rather than maintaining internal state, suggesting a fundamentally different mechanism than human goal-directed behavior.
This paper investigates how large language models internally represent and pursue goals. Researchers found that specific attention heads encode the next sub-goal, and this encoding causally influences the model's actions.