Language models can generate their own training data for instruction-following — Self-Instruct enabled the open-source alignment movement (Alpaca, Vicuna, etc.).
Introduces a framework for improving instruction-following by generating instruction-output pairs from the model itself. Starting from 175 seed tasks, the model bootstraps 52K instructions, producing an aligned model that approaches InstructGPT quality.