You can directly control VLM safety by setting explicit budgets on harmful assistance rates and using a two-channel reward design that preserves the safety multiplier signal through training.
This paper addresses how to directly control safety in vision-language models using reinforcement learning. The authors propose a two-channel constrained GRPO method that treats safety as explicit budgets (acceptable rates of harmful outputs and over-refusal) enforced through Lagrange multipliers.