Comment on Mesh LLM: distributed AI computing on irohComments−roger_2moDoes this support Qwen 3.6 (e.g. 27B) and the myriad of llama.cpp options (batch sizes, quantization, etc.)?I'd love to see some performance data.−sig_kill2moYes! I’ve worked on the settings interface between our runtime and llamacpp, these are documented and available via our config.toml file
Comments
Does this support Qwen 3.6 (e.g. 27B) and the myriad of llama.cpp options (batch sizes, quantization, etc.)?
I'd love to see some performance data.
Yes! I’ve worked on the settings interface between our runtime and llamacpp, these are documented and available via our config.toml file