Comment on Ollama for Linux – Run LLMs on Linux with GPU AccelerationparentComments−dorfsmay2yrun their own LLMs on Linux and the unfortunate answer was always that the existing options were slightly complicateWhat about https://github.com/ggerganov/llama.cpp ?It compiles and run easily on Linux.−vorticalbox2yOr https://gpt4all.io/index.htmlThough doesn't currently support GPU.
Comments
What about https://github.com/ggerganov/llama.cpp ?
It compiles and run easily on Linux.
Or https://gpt4all.io/index.html
Though doesn't currently support GPU.