Compliance controls for autonomous agents need careful tuning—blocking all risky behavior often breaks legitimate functionality, and adversarial testing reveals gaps that normal operation doesn't expose.
This paper introduces TradeGauntlet, a simulator for testing compliance controls in autonomous trading agents. Researchers evaluated how well different safeguards (alerts, gates, reminders) prevent problematic trades while keeping legitimate trading practical, testing with Claude models and finding that simple metrics like zero alerts don't guarantee compliance.