Skip to content

Comment on MLC-LLM: GPT/Llama on consumer-class GPUs and phonesparent

Comments

What's the excitement about getting it almost running on a phone about?

You get to decide what is appropriate or not.

It works offline.

It can be used to by applications without the having to use an external service.

This can be important for a number of applications (I am thinking about open source games and the modding community right now, but it is just an example)

email works on localhost if you don’t want to email anybody

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.