Python is used because there are C/C++ bindings for working with NNs.

The point is that none of computations are done in pure Python. Python just provides a convenient wrapper over non-Python code.