Skip to content

Comment on LoRA Without Regretparent

Comments

If you're going to be snarky, could you at least clarify what the answer is for those of us who don't stay on top of ML research...?

If you're going to be snarky, could you at least clarify what the answer is for those of us who don't stay on top of ML research...?

The answer is "There's a difference, perhaps", but the GP appeared to imply that LoRA performed worse.

My understanding is that that paper found differences, but did not conclude that the differences were quantifiably better or worse, but this is not what GP's post implied.

The paper does not make any clear conclusions about LoRA vs FullFT performance, beyond "the two methods seem to be learning different things".

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.