Comment on ONNX runtime: Cross-platform accelerated machine learningComments−FloatArtifact3yWould it not be better to use https://github.com/tinygrad/tinygrad as an intermediary framework?−new_user553yTinygrad is python only right? Can it provide gradients during C++ runtime as well? ONNX runtime have multiple language backends for inference.−figomore3yOne option to your case is OpenVino. It's written in C++ and has Python Bindings. Also, it can be used to train new nets. You can use ONNX files with OpenVino too.
Comments
Would it not be better to use https://github.com/tinygrad/tinygrad as an intermediary framework?
Tinygrad is python only right? Can it provide gradients during C++ runtime as well? ONNX runtime have multiple language backends for inference.
One option to your case is OpenVino. It's written in C++ and has Python Bindings. Also, it can be used to train new nets. You can use ONNX files with OpenVino too.