The probability of observed data averaged over all possible model parameters, representing the true statistical objective for learning.