Continuous adversarial training can reliably improve LLM honesty across different scenarios without sacrificing model capabilities, and this improvement transfers to new domains better than existing methods.
This paper introduces CATCH, a training method that makes large language models more honest by using adversarial training to push models toward truthful answers and away from dishonest ones.