Skip to content

Comment on LoRA Without Regretparent

Comments

Unsloths documentation probably gets as close to practical as it can get: https://docs.unsloth.ai/get-started/fine-tuning-llms-guide

Be sure to validate everything you're reading though as of late I've come across more and more things that don't seem 100% accurate in their docs, seems to heavily depend on what section.

My sense is they need to go back and update previous docs; they release a lot of software updates and a lot of notebooks showing how to use the features, but the two might fall out of sync. Would that match your observations?

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.