When hidden units reach extreme values (near -1 or 1 for tanh), causing gradients to vanish and learning to stall.