Current LLMs fail at maintaining reliable decision-making in dynamic environments; strong performance on static tasks doesn't guarantee agents can adapt when the world changes, highlighting a critical gap in agent robustness.
This paper introduces GeoWorld, a platform simulating real-world geographic environments that change over time, and LiveGeo, a benchmark for testing how well LLM agents make decisions in these dynamic settings.