Comment on AMD Instinct MI325X in Q4 2024, 288GB of HBM3EparentComments−ai_what2yI mean it's the price of 2 * Apple Mac Pro's. It isn't exactly unheard of.Just a few weeks ago I spoke to someone who shelled out $10k for running LLM's locally. I've seen more expensive builds as well.
Comments
I mean it's the price of 2 * Apple Mac Pro's. It isn't exactly unheard of.
Just a few weeks ago I spoke to someone who shelled out $10k for running LLM's locally. I've seen more expensive builds as well.