Comment on Running a 28.9M parameter LLM on an $8 microcontrollerparentComments−npodbielski1moRig with 6x RTX 5090. I would not say it is RAM only−3eb7988a16631moUnless I am mis-reading the benchmarks, some of those are run as CPU only, no GPU involvement.
Comments
Rig with 6x RTX 5090. I would not say it is RAM only
Unless I am mis-reading the benchmarks, some of those are run as CPU only, no GPU involvement.