Parameter allocation strategy that uses lower-rank gates for operations that have less impact on model output and reinvests savings elsewhere.