Comment on Ask HN: 16 yo Nephew, in E. Africa, wants to train an LLM with on disk WikipediaparentComments−icsa2yHave him check out:LLM training in simple, raw C/CUDA----------------------------------https://github.com/karpathy/llm.cIt is only 1,000 lines of easy to read C code. There is also Python reference code.
Comments
Have him check out:
LLM training in simple, raw C/CUDA
----------------------------------
https://github.com/karpathy/llm.c
It is only 1,000 lines of easy to read C code. There is also Python reference code.