Comment on MLC-LLM: GPT/Llama on consumer-class GPUs and phonesparentComments−juliangoldsmith3yrllama has an OpenCL version, though I wasn't able to test it.
Comments
rllama has an OpenCL version, though I wasn't able to test it.