Comment on MLC-LLM: GPT/Llama on consumer-class GPUs and phonesparentComments−dhruvdh3yHow do you imagine consoles work? And what about Apple's tight integration has actually made itself useful? The developer experience is terrible.−valine3yIt’s useful because you can buy a Macbook with 64GB of RAM, and then use that RAM as VRAM to run your LLM.
Comments
How do you imagine consoles work? And what about Apple's tight integration has actually made itself useful? The developer experience is terrible.
It’s useful because you can buy a Macbook with 64GB of RAM, and then use that RAM as VRAM to run your LLM.