Comment on State-of-the-Art Chatbot, Vicuna-7B, now runs on MacBook with GPU accelerationparentComments−GaggiX3ySomeone really needs to write a script that does not load both entire models into memory to do this.
Comments
Someone really needs to write a script that does not load both entire models into memory to do this.