nickthegreek on State-of-the-Art Chatbot, Vicuna-7B, now runs on MacBook with GPU acceleration · Hackerly

Comment on State-of-the-Art Chatbot, Vicuna-7B, now runs on MacBook with GPU acceleration parent

nickthegreek 3y

https://huggingface.co/Pi3141/alpaca-lora-30B-ggml

I believe I’m using alpaca.cpp with a command:

./chat -m <bin filename>