It's a pity they don't do a complete rewrite with a functional language as the driver.

It's open source, so seeing such an extension would be quite cool. There's much that could be done with native Rust actors and code that get maybe at what you want, but nothing precludes mixing PyTorch and other backends.

For example, you could wrap a C++ inference engine as part of one of the actors generating data for other actors doing distributed training.