Comment on Ask HN: Best platform for self-hosting LLM Models?Comments−runjake2yBest platform would be hellishly expensive cloud compute or an expensive PC with a beefy, expensive Nvidia GPU, all of which generates a lot of heat.I personally get a lot of mileage out of an M3 Max with 36gb memory.
Comments
Best platform would be hellishly expensive cloud compute or an expensive PC with a beefy, expensive Nvidia GPU, all of which generates a lot of heat.
I personally get a lot of mileage out of an M3 Max with 36gb memory.