Comment on Megatron-Turing NLG 530B, the World’s Largest Generative Language ModelparentComments−visarga4yBut then you try to predict the next token on a completely unseen piece of the corpus and fail miserably if all you do is store the training data.
Comments
But then you try to predict the next token on a completely unseen piece of the corpus and fail miserably if all you do is store the training data.