simonw on MLC-LLM: GPT/Llama on consumer-class GPUs and phones · Hackerly

Comment on MLC-LLM: GPT/Llama on consumer-class GPUs and phones parent

Have you got those to work on an iPhone?

Have it working on mine!