vorticalbox on Ollama for Linux – Run LLMs on Linux with GPU Acceleration · Hackerly

Comment on Ollama for Linux – Run LLMs on Linux with GPU Acceleration parent

Or https://gpt4all.io/index.html

Though doesn't currently support GPU.