Comment on MLC-LLM: GPT/Llama on consumer-class GPUs and phonesparentComments−vGPU3yLikely due to the model used. It looks like they’re presenting this as a framework so it should be possible to substitute a different model in.
Comments
Likely due to the model used. It looks like they’re presenting this as a framework so it should be possible to substitute a different model in.