Holy misleading headlines Batman. They're not spending $3.4B on solely tokens for Anthropic are they? I don't think so...
If anything the CTO is just saying, we're blowing through token budgets way faster than expected as the uptake is so immense. I think that's right from what I've seen. Once people get it, they start using AI for everything. Obviously that's not going to be sustainable forever. I do think we're going to see a lot of adaptive routing in the future to cheaper models for more mundane tasks, whereas right now everything is getting routed to Opus regardless of real need.
Why would that not be sustainable forever? Over the long run the price per token is likely to decline as both hardware and software gets more efficient.
Comments
Holy misleading headlines Batman. They're not spending $3.4B on solely tokens for Anthropic are they? I don't think so...
If anything the CTO is just saying, we're blowing through token budgets way faster than expected as the uptake is so immense. I think that's right from what I've seen. Once people get it, they start using AI for everything. Obviously that's not going to be sustainable forever. I do think we're going to see a lot of adaptive routing in the future to cheaper models for more mundane tasks, whereas right now everything is getting routed to Opus regardless of real need.
Why would that not be sustainable forever? Over the long run the price per token is likely to decline as both hardware and software gets more efficient.
It’s being subsidized by investor cash bonfires right now isn’t it? TBD if it gets cheap to operate before those run out.
So what? Even if investor cash runs out the price of compute capacity always declines over the long term.
Okay what if cash run out before compute price decline? Grug grug.