That is helpful, thank you.

But the most concerning issue however, in my opinion, and taking into account the amount of attention that the NTM paper got, is that (to my knowledge) all public implementations of the suggested architecture involve a great deal of guesswork. The researchers didn’t release any code; only vague details about the architecture and results that we must take on their word. The note they released is, I think, closer to being a tantalizing press release than a proper scientific report.