Comment on Building an AI server on a budgetparentComments−throwaway3141551yThe other main caveat is that installing from custom sources using apt is a massive pain in the ass.−koakuma-chan1yI tried running an LLM locally today, installed cuda toolkit, and it was missing cudann.hI gave up.
Comments
The other main caveat is that installing from custom sources using apt is a massive pain in the ass.
I tried running an LLM locally today, installed cuda toolkit, and it was missing cudann.h
I gave up.