Most LLM agent failures in real incidents aren't from prompt injection attacks—they're from agents missing ordinary operational hazards. Specific hazard warnings work better than generic safety notes at preventing harm.
ROGUE-AI is a framework that recreates real-world incidents involving LLM agents (like deleting databases or sending payments) to understand why they fail. By rebuilding incidents offline with and without the suspected cause, researchers found that 89% of incidents could be reproduced, and that most failures weren't from attacks but from agents missing ordinary hazards like shared databases.