Comment on MLC-LLM: GPT/Llama on consumer-class GPUs and phonesparentComments−nl3yDoes it? I'm not aware of any way to share main memory with the Jetson CUDA cores.If I'm wrong I'd love a pointer to the docs about it!
Comments
Does it? I'm not aware of any way to share main memory with the Jetson CUDA cores.
If I'm wrong I'd love a pointer to the docs about it!