An exponential moving average copy of the student model used as a teacher, updated gradually to provide stable learning signals.