Comment on Local LLM inference – impressive but too hard to work withComments−Havoc1yDon’t think the cost point is correct. Last I saw calcs api was cheaper than the juice needed to run a local gpu. Never mind equipmentPlus there are a mountain of free tokens out there like Gemini free
Comments
Don’t think the cost point is correct. Last I saw calcs api was cheaper than the juice needed to run a local gpu. Never mind equipment
Plus there are a mountain of free tokens out there like Gemini free