Even if LLMs get no better than they are today, we will still have valid practical applications that use them.
That's only true when they are heavily, heavily subsidized. If that $200/month spend could or should be $2000/month, or maybe even as high as $20,000/month, would it still be "practical"?
The truth is we don't really know what these tokens actually cost - the actual cost of the data center, the hardware in the datacenter, the fantastic amounts of electricity it uses daily, the warming of the planet, etc, etc...
Are you sure you want to frame them as "practical"?
Comments
That's only true when they are heavily, heavily subsidized. If that $200/month spend could or should be $2000/month, or maybe even as high as $20,000/month, would it still be "practical"?
The truth is we don't really know what these tokens actually cost - the actual cost of the data center, the hardware in the datacenter, the fantastic amounts of electricity it uses daily, the warming of the planet, etc, etc...
Are you sure you want to frame them as "practical"?
The research is subsidized, inference is profitable.