Comment on Show HN: Llama.go – port of llama.cpp to pure GoComments−smcleod3y"Pure Go" ... looks at repo - 16.9% python.−barelysapient3yThe op only claimed to rewrite the llama.cpp in go, not the entire project. If look at llama/llama.go, it’s all written in go.−AmbixOP3yPython needed only to converting PyTorch models into more accessible bin format :) All the inference and tensor math code is 100% Golang. I'm going to inject AVX2 assembler soon, but that's too very specific to Go ecosystem.
Comments
"Pure Go" ... looks at repo - 16.9% python.
The op only claimed to rewrite the llama.cpp in go, not the entire project. If look at llama/llama.go, it’s all written in go.
Python needed only to converting PyTorch models into more accessible bin format :) All the inference and tensor math code is 100% Golang. I'm going to inject AVX2 assembler soon, but that's too very specific to Go ecosystem.