The gradient of the upper-level objective with respect to hyperparameters, computed using lower-level solution information.