Skip to content

Comment on MLC-LLM: GPT/Llama on consumer-class GPUs and phonesparent

Comments

There are two compelling reasons:

1) for people who want to make money using AI but can’t afford to pay for a LLM or servers, they can push that cost to the end user.

2) for people who want to generate porn or spam (probably, also to make money)

The privacy thing is complete nonsense. If you want a private server, rent your own private server. If you’re worried AWS is spying on you, you’re paranoid.

This is about money, making money and being cheap, not about good will.

So, you’re right; from a consumer perspective it’s pretty meaningless.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.