I think he wants to tinker, and learn more about how they work. What I neglected to mention is that he's already learned to program (developing Android apps, and he's also learned Python). He is a very bright and curious kid.
Btw, I support some Kenyan high school students and am looking at supplying a few schools with llamafile+models on flash drives for their computer science curricula.
I'm reviewing models, at the moment. Model selection will depend greatly on the hardware capabilities at each school. Phi-3 could be a good starting point.
The project is an idea at the moment. My contact in Kenya has direct access to the Principals of the schools that our supported students attend.
My thought is that the teachers would not have to do much. Many of the students already know python and could do self-learning individually or in groups.
A flash drive with llamafile+models and documentation might be all that it would take to get them started - even offline.
Bonus: Using llamafile, the same binary distribution works on MacOS, Linux, and Windows.
Comments
That is a great suggestion, thank you!
I think he wants to tinker, and learn more about how they work. What I neglected to mention is that he's already learned to program (developing Android apps, and he's also learned Python). He is a very bright and curious kid.
Have him check out:
LLM training in simple, raw C/CUDA
----------------------------------
https://github.com/karpathy/llm.c
It is only 1,000 lines of easy to read C code. There is also Python reference code.
Btw, I support some Kenyan high school students and am looking at supplying a few schools with llamafile+models on flash drives for their computer science curricula.
That's interesting. Could you expand on this a bit more? Which models, and I am curious about how the CS teachers/students will be using this?
I'm reviewing models, at the moment. Model selection will depend greatly on the hardware capabilities at each school. Phi-3 could be a good starting point.
The project is an idea at the moment. My contact in Kenya has direct access to the Principals of the schools that our supported students attend.
My thought is that the teachers would not have to do much. Many of the students already know python and could do self-learning individually or in groups.
A flash drive with llamafile+models and documentation might be all that it would take to get them started - even offline.
Bonus: Using llamafile, the same binary distribution works on MacOS, Linux, and Windows.
Thanks for the detailed response.
I wasn't aware of Phi-3 - I will look into it.