Comment on DyLoRA: Parameter Efficient Tuning of Pre-Trained ModelsparentComments−whimsicalism3yIt's very different, but hard to distill in a comment. They use a new regularization technique to basically create a LoRA with dynamically adjustable rank.
Comments
It's very different, but hard to distill in a comment. They use a new regularization technique to basically create a LoRA with dynamically adjustable rank.