Comment on OpenAI releasing new open model in coming months, seeks community feedbackparentComments−rockinghigh1yThey could provide access to the training code. It's useful for training smaller models or distilling larger ones. They don't need to release every details involved in tuning the optimization parameters during the pre-training stage.−fooker1yThere is no training 'code' that will get you anything close to a usable result.
Comments
They could provide access to the training code. It's useful for training smaller models or distilling larger ones. They don't need to release every details involved in tuning the optimization parameters during the pre-training stage.
There is no training 'code' that will get you anything close to a usable result.