Comment on MLC-LLM: GPT/Llama on consumer-class GPUs and phonesComments−int_19h3yThe installation process includes downloading precompiled binaries from this repo:https://github.com/mlc-ai/binary-mlc-llm-libsIs the code from which these are built available somewhere? How does one go about building one for their own model?
Comments
The installation process includes downloading precompiled binaries from this repo:
https://github.com/mlc-ai/binary-mlc-llm-libs
Is the code from which these are built available somewhere? How does one go about building one for their own model?