Skip to content

Comment on AirLLM enables 8GB MacBook run 70B LLM

Comments

I did not dig too deep in the technicalities of it, but is there anything that would stop openAI from also implementing something like this ?

Presumably any advances open source community makes towards running on cheap hardware, will also massively benefit the big guys.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.