Comment on Llama.cpp guide – Running LLMs locally on any hardware, from scratchComments−nobodyandproud1yThis was nice. I took the road less traveled and tried building on Windows and AMD.Spoiler: Vulkan with MSYS2 was indeed the easiest to get up and running.I actually tried w64devkit first and it worked properly for llama-server, but there were inexplicable plug-in problems with llama-bench.Edit: I tried w64devkit before I read this write-up and I was left wondering what to try next, so the timing was perfect.
Comments
This was nice. I took the road less traveled and tried building on Windows and AMD.
Spoiler: Vulkan with MSYS2 was indeed the easiest to get up and running.
I actually tried w64devkit first and it worked properly for llama-server, but there were inexplicable plug-in problems with llama-bench.
Edit: I tried w64devkit before I read this write-up and I was left wondering what to try next, so the timing was perfect.