Skip to content

Comment on Nvidia projects $673B in sales as AI demand widensparent

Comments

Anthropic and OpenAI frequently “reset” customer limits to allow them to use even more resources at no additional cost.

Surely this applies to fixed-price subscriptions, not per-token spend? Large enterprises (the "very very resource intensive" large-scale users) have to pay per token.

A lot of companies avoid paying for usage by encouraging their employees to use individual subscriptions. Outside of the short lived tokenmaxxing fever dream, enterprises are conscious of their usage with companies like Uber and Amazon reigning in their usage massively and companies like Ramp building their own routers for cost minimization.

Facebook is reportedly the company that spent $500 million in a single month on tokens. There are individual non-enterprise users rotating multiple subscriptions incurring $10k+ in tokens per subscription. Facebook’s $500 million month… is equivalent to ~10k individual subscriptions which could be as little as a few thousand of the heaviest users. That’s $500 million when billed on usage, or ~$2 million on plans.

The reason resets are such a big deal (people have set up websites to track them, tweets announcing them get millions of impressions) is because there are huge numbers of users pushing their plan limits every single day. If there was huge demand from usage-based customers (the large enterprises) that OpenAI and Anthropic couldn’t meet, they wouldn’t be handing out resets like candy.

I think a realistic belief is that Anthropic and OpenAI have vastly overstated demand and are using resets as a way to keep usage artificially inflated at a substantial financial cost. I’d guess fixed price plan users make up at least 95% of usage.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.