Comment on Ask HN: Do you think Python will disappear for LLM inference?parentComments−astronautasOP1yI agree Python is hardly replacable. Btw, I only mean inference, not training. Training imho should stay pure Python, you can achieve mega throughout with it for batch processing.−franktankbank1yBtw, I only mean inferenceD'oh! Yea that changes things. I would be considering UI integration from the inference side.
Comments
I agree Python is hardly replacable. Btw, I only mean inference, not training. Training imho should stay pure Python, you can achieve mega throughout with it for batch processing.
D'oh! Yea that changes things. I would be considering UI integration from the inference side.