A theoretical proof that an optimization algorithm will monotonically improve performance with each update step.