Comment on AirLLM enables 8GB MacBook run 70B LLMComments−great_psy2yI did not dig too deep in the technicalities of it, but is there anything that would stop openAI from also implementing something like this ?Presumably any advances open source community makes towards running on cheap hardware, will also massively benefit the big guys.
Comments
I did not dig too deep in the technicalities of it, but is there anything that would stop openAI from also implementing something like this ?
Presumably any advances open source community makes towards running on cheap hardware, will also massively benefit the big guys.