Skip to content

Comment on Ask HN: Not much interest in offline CPU LLMs that may kill SaaS?

Comments

I think there're a few problems, unfortunately:

- It wouldn't quite work on mobile devices. Many ppl wouldn't like to download 4GB on their iPhone; - Many use cases involve real-time data - e.g. summary of the latest news and events. That would require the LLM to be updated often and be able to perform actions like Google searches; - Switching devices will lose the history, created artefacts, etc.

While I think there're use cases, IMHO, they would be mostly for tech experts and not the wider audience.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.