Comment on Llama.cpp guide – Running LLMs locally on any hardware, from scratchparentComments−phillipcarter1yI just use ollama. It works on my mac and windows machine and it's super simple to install + run most open models. And you can have another tool just shell out to it if you want more than than the CLI.
Comments
I just use ollama. It works on my mac and windows machine and it's super simple to install + run most open models. And you can have another tool just shell out to it if you want more than than the CLI.