LoRA adapters waste capacity by not fully utilizing their configured rank; adding an effective-rank regularizer during training fixes this and improves the learning-forgetting trade-off without extra computational cost.
This paper identifies why LoRA adapters underperform full fine-tuning: they don't use their full capacity. The authors show that LoRA updates have much lower effective rank than their configured rank, limiting how broadly parameter updates spread.