I see almost no discussion about the use cases for extremely fast diffusion models like Mercury which can apparently reach 1,000+ tps throughput, at an intelligence level around 32 on the Artificial Analysis Intelligence Index (according to Inception's webpage). Obviously this is a dumb model, but that level intelligence is close to Luna at Low effort level, which is good enough for basic tasks. I think these fast models open up a world of possibilities, especially as they get faster. I imagine workflows where, instead of taking time to write a prompt, I can rapidly iterate on the output by clicking through options. I'm wondering if anybody else is thinking about these possibilities?
Comments
I see almost no discussion about the use cases for extremely fast diffusion models like Mercury which can apparently reach 1,000+ tps throughput, at an intelligence level around 32 on the Artificial Analysis Intelligence Index (according to Inception's webpage). Obviously this is a dumb model, but that level intelligence is close to Luna at Low effort level, which is good enough for basic tasks. I think these fast models open up a world of possibilities, especially as they get faster. I imagine workflows where, instead of taking time to write a prompt, I can rapidly iterate on the output by clicking through options. I'm wondering if anybody else is thinking about these possibilities?