Comment on Show HN: Tiny-vLLM – high performance LLM inference engine in C++ and CUDAComments−sylware3moI am looking at a plain and simple C implemented LLM inference, and/or x86_64 assembly implemented, and/or AMD GPU RDNA assembly.Anybody?−irishcoffee3moI heard once that c++ can become assembly at some point if you type the right things in. :)−sylware3moWell, the whole purpose is to be independent of invisible backdoor injectors...^W I mean compiler, to be more accurate those compilers which deals with computer languages with an absurd and grotesque syntax complexity.
Comments
I am looking at a plain and simple C implemented LLM inference, and/or x86_64 assembly implemented, and/or AMD GPU RDNA assembly.
Anybody?
I heard once that c++ can become assembly at some point if you type the right things in. :)
Well, the whole purpose is to be independent of invisible backdoor injectors...^W I mean compiler, to be more accurate those compilers which deals with computer languages with an absurd and grotesque syntax complexity.