AI can supervise its own alignment by following explicit principles — Constitutional AI reduces the need for human labelers while maintaining or improving safety.
Proposes Constitutional AI (CAI), where a model critiques and revises its own outputs according to a set of principles, then trains a preference model from the AI-generated feedback. Reduces reliance on human red-teaming while producing less harmful outputs.