Reward signals broken down by a verifier component to guide safe behavior during multi-step exploration.