Skip to content

Comment on Building an AI server on a budgetparent

Comments

Personal opinion, it's for fun with some internal narrative of justification. It doesn't seem like it would be cost effective or provide better results, as all the major LLM vendors benefit tremendously from economies of scale, and the monthly fees for these services are extremely reasonable for what you are getting. Going further, the cloud based LLM receive upgrades constantly while static hardware will likely lock you out of future models at some time horizon.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.