MLC LLM: Universal LLM Deployment with GPU Accelerationgithub.com/mlc-ai 3 pointscrowwork3 years ago1 commentSaveHideCopy link On HNComments−crowworkOP3ySupported platforms include:- Metal GPUs on iPhone and Intel/ARM MacBooks- AMD and NVIDIA GPUs via Vulkan on Windows and Linux- NVIDIA GPUs via CUDA on Windows and Linux- WebGPU on browsers (through companion project WebLLM).
Comments
Supported platforms include:
- Metal GPUs on iPhone and Intel/ARM MacBooks
- AMD and NVIDIA GPUs via Vulkan on Windows and Linux
- NVIDIA GPUs via CUDA on Windows and Linux
- WebGPU on browsers (through companion project WebLLM).