Operator overloading is a major reason why libraries like pytorch exist so IMO that's a moot point.
Btw there's ongoing work to automatically optimize expressions like this. See the XLA compiler for example. Right now deep learning has a ton of seemingly obvious compute/memory optimisations that are not done automatically.
Comments
Operator overloading is a major reason why libraries like pytorch exist so IMO that's a moot point.
Btw there's ongoing work to automatically optimize expressions like this. See the XLA compiler for example. Right now deep learning has a ton of seemingly obvious compute/memory optimisations that are not done automatically.