Fine tuning where you freeze the weights of a neural network has been used for a long time in computer vision. There are many variations of these methods.
More recently there are some good libraries that make them easier to use. For example PEFT, which implements LoRA and several other related methods.
Comments
Fine tuning where you freeze the weights of a neural network has been used for a long time in computer vision. There are many variations of these methods.
More recently there are some good libraries that make them easier to use. For example PEFT, which implements LoRA and several other related methods.
https://huggingface.co/blog/peft
I wouldn't recommend PEFT unless you're only working with models pulled from the huggingface hub.