Comment on Running a 28.9M parameter LLM on an $8 microcontrollerComments−anonymous3441moi don't care about microcontroller, what is the decent option to have local llm in my raspi4 that does not take 30 seconds to answer?−Rohansi1moRun a smaller LLM. It won't be as smart but the one shown here isn't either.
Comments
i don't care about microcontroller, what is the decent option to have local llm in my raspi4 that does not take 30 seconds to answer?
Run a smaller LLM. It won't be as smart but the one shown here isn't either.