Comment on MLC-LLM: GPT/Llama on consumer-class GPUs and phonesparentComments−valine3yIt’s useful because you can buy a Macbook with 64GB of RAM, and then use that RAM as VRAM to run your LLM.
Comments
It’s useful because you can buy a Macbook with 64GB of RAM, and then use that RAM as VRAM to run your LLM.