I’ve been using this on my MacBook Pro for the last couple weeks and want to say thank you!
As a solutions developer not so much interested in training models but leveraging them in a pipeline, I hadn’t bothered to try to run anything locally due to the complexity of setup, even with llama.cpp. You enabled me to be up and running in just a few minutes.
Comments
I’ve been using this on my MacBook Pro for the last couple weeks and want to say thank you!
As a solutions developer not so much interested in training models but leveraging them in a pipeline, I hadn’t bothered to try to run anything locally due to the complexity of setup, even with llama.cpp. You enabled me to be up and running in just a few minutes.
give Dumbar a try, since you're on macOS! https://github.com/JerrySievert/Dumbar