Comment on Ollama for Linux – Run LLMs on Linux with GPU AccelerationparentComments−brucethemoose22yThis one is basically SOTA for AMD, if you can install rocm properly:https://github.com/YellowRoseCx/koboldcpp-rocmSome other projects support rocm less explicitly, and not as easily.
Comments
This one is basically SOTA for AMD, if you can install rocm properly:
https://github.com/YellowRoseCx/koboldcpp-rocm
Some other projects support rocm less explicitly, and not as easily.