A method for efficiently updating model parameters or memory states during forward passes without full recomputation.