idiotsecant on New attention mechanisms that outperform standard multi-head attention · Hackerly

Comment on New attention mechanisms that outperform standard multi-head attention parent

The answer might just be scale for all we know.