Comment on Ask HN: How is everyone using Local LLMs?Comments−verdverm1moI'm running ~6 small models on an oem spark to back the various features of my personal knowledge base tool. A couple of LLMs and some non-llms toohttps://github.com/verdverm/gmdI run a "bigger" model on a second spark for coding tasks with an OpenCode Go sub for big models. It's nice to have access to the best open weight as well.
Comments
I'm running ~6 small models on an oem spark to back the various features of my personal knowledge base tool. A couple of LLMs and some non-llms too
https://github.com/verdverm/gmd
I run a "bigger" model on a second spark for coding tasks with an OpenCode Go sub for big models. It's nice to have access to the best open weight as well.