That’s fair, but my impression is that AI is a very industry-driven field. When commercialization fails, industry funding dries up and drags gov funding down too, resulting in an AI winter.
And industry really cares about solving practical problems. So as soon as autoregression “solved” the text generation problem (albeit imperfectly) the field was ready to move on. If text diffusion is not faster, cheaper, or higher quality, there is no ROI.
In fact text diffusion is much faster, so I have used it in the past. And I think it has the potential to be better as well, given a constant time budget. So I think it can be a really promising method moving forward.
Comments
That’s fair, but my impression is that AI is a very industry-driven field. When commercialization fails, industry funding dries up and drags gov funding down too, resulting in an AI winter.
And industry really cares about solving practical problems. So as soon as autoregression “solved” the text generation problem (albeit imperfectly) the field was ready to move on. If text diffusion is not faster, cheaper, or higher quality, there is no ROI.
In fact text diffusion is much faster, so I have used it in the past. And I think it has the potential to be better as well, given a constant time budget. So I think it can be a really promising method moving forward.