Comment on Show HN: Fine-tune an 8B model on a 4 GB laptop GPUComments−victor1061moHow much data do you need to fine tune a model?−MakazhanAlpamysOP1moDepends what you change. Format or style, few hundred rows is often enough. A task the model already half knows, few thousand.New facts is where people waste a week. The model comes back wrong in a new way. Use RAG for facts.
Comments
How much data do you need to fine tune a model?
Depends what you change. Format or style, few hundred rows is often enough. A task the model already half knows, few thousand.
New facts is where people waste a week. The model comes back wrong in a new way. Use RAG for facts.