Comment on Llama.cpp guide – Running LLMs locally on any hardware, from scratchparentComments−homarp1yyou can do that with llama-server too
Comments
you can do that with llama-server too