Comment on Continuous Diffusion Language Models (CDLM's)Comments−amelius12d"Attention is all you need" should be renamed into "Attention is sufficient but not necessary".−p1esk12dIt’s the opposite: attention is necessary but not sufficient.−slashdave12dJust about anyone building a large diffusion model is relying on transformers−ViscountPenguin12dA quick look at the continuous diffusion models linked in the post shows lots of transformer models still
Comments
"Attention is all you need" should be renamed into "Attention is sufficient but not necessary".
It’s the opposite: attention is necessary but not sufficient.
Just about anyone building a large diffusion model is relying on transformers
A quick look at the continuous diffusion models linked in the post shows lots of transformer models still