Comment on QLoRA: Efficient Finetuning of Quantized LLMsComments−MacsHeadroom3y"We use QLoRA to finetune more than 1,000 models"Over 1,000 models finetuned! Finetuning 65B models on consumer hardware in under a day, with full 16bit finetune performance.4bit does it again!
Comments
"We use QLoRA to finetune more than 1,000 models"
Over 1,000 models finetuned! Finetuning 65B models on consumer hardware in under a day, with full 16bit finetune performance.
4bit does it again!