Comment on Keras Core: Keras for TensorFlow, Jax, and PyTorchparentComments−cygn3yYou can just use Triton which is basically TFserve for Tensorflow, Pytorch, Onnx and more.−albertzeyer3yCan you explain that?My understand of Triton is more that this is an alternative to CUDA, but instead you write it directly in Python, and on a slightly higher-level, and it does a lot of optimizations automatically. So basically: Python -> Triton-IR -> LLVM-IR -> PTX.https://openai.com/research/triton−chillee3yIt's confusing, there's OpenAI Triton (what you're thinking of) and Nvidia Triton server (a different thing).−jerrygenser3yOriginal comment is referring to Nvidia triton inference server
Comments
You can just use Triton which is basically TFserve for Tensorflow, Pytorch, Onnx and more.
Can you explain that?
My understand of Triton is more that this is an alternative to CUDA, but instead you write it directly in Python, and on a slightly higher-level, and it does a lot of optimizations automatically. So basically: Python -> Triton-IR -> LLVM-IR -> PTX.
https://openai.com/research/triton
It's confusing, there's OpenAI Triton (what you're thinking of) and Nvidia Triton server (a different thing).
Original comment is referring to Nvidia triton inference server