Mathematical functions that measure how far a model's output is from desired behavior, designed to be optimizable via gradient descent.