Take a look at: https://huggingface.co/blog/trl-peft