RL post-training of diffusion models works largely through input-independent activation steering, meaning you can recover most improvements with a tiny fixed vector added to frozen model outputs—this has major implications for understanding and efficiently improving generative models.
This paper shows that RL improvements to diffusion transformers come primarily from simple activation steering—adding fixed vectors to model outputs—rather than learning complex input-dependent changes.