Comment on Training NanoGPT on My JournalparentComments−hut3yAuthor here :) Some results (around 50%) are from a NN trained on 1.77MB of my notes, and others are from another NN trained on 1.25MB of my notes and 2MB of a random slice of "openwebtext" (OpenAI's WebText dataset from GPT2).
Comments
Author here :) Some results (around 50%) are from a NN trained on 1.77MB of my notes, and others are from another NN trained on 1.25MB of my notes and 2MB of a random slice of "openwebtext" (OpenAI's WebText dataset from GPT2).