Comment on Local LLM inference – impressive but too hard to work withparentComments−rzzzt1yI thought it's "docker model" (and OCI artifacts).−dust421yllamafile is a multiplatform executable that wraps the model and a slightly modified version of llama.cpp. IIRC funded by Moz.
Comments
I thought it's "docker model" (and OCI artifacts).
llamafile is a multiplatform executable that wraps the model and a slightly modified version of llama.cpp. IIRC funded by Moz.