Comment on Without benchmarking LLMs, you're likely overpayingparentComments−PunchyHamster7moLLM bubble will burst the second investors figure out how much well managed local model can do−verdverm7moExcept that1. There is still night and day difference2. Local is slow af3. The vast majority of people will not run their own models4. I would have to spend more than $200+ a month on frontier AI to come close the same price it would cost for any decent AI at home rig. Why would I not use frontier models at this point?
Comments
LLM bubble will burst the second investors figure out how much well managed local model can do
Except that
1. There is still night and day difference
2. Local is slow af
3. The vast majority of people will not run their own models
4. I would have to spend more than $200+ a month on frontier AI to come close the same price it would cost for any decent AI at home rig. Why would I not use frontier models at this point?