Comment on Baking a Model: A Metaphor for LLM TrainingComments−Alephinitesimal24dBaking is a good metaphor, though lately it also feels a bit like making liquor. Distillation is a surprisingly important part of training.
Comments
Baking is a good metaphor, though lately it also feels a bit like making liquor. Distillation is a surprisingly important part of training.