Comment on Ollama for Linux – Run LLMs on Linux with GPU AccelerationparentComments−spmurrayzzz2yllama.cpp added ROCm linux support a little over a month ago. Details on that can be found in their readme: https://github.com/ggerganov/llama.cpp#hipblas (no luck for windows users though)
Comments
llama.cpp added ROCm linux support a little over a month ago. Details on that can be found in their readme: https://github.com/ggerganov/llama.cpp#hipblas (no luck for windows users though)