Token cost is falling rapidly for a given quality. We don't think about this too much as newer models have made legacy apps obsolete - but its an interesting question what the cheapest text to sql or similar model would be. I still go by 10x cost decrease per 6 months for any given model quality.
Comments
But will the wrapper apps cover token cost, or will tokens act more like electricity?
Token cost is falling rapidly for a given quality. We don't think about this too much as newer models have made legacy apps obsolete - but its an interesting question what the cheapest text to sql or similar model would be. I still go by 10x cost decrease per 6 months for any given model quality.