Skip to content

Comment on Thelio Mira AI Linux Workstation: 192 GB GPU Memoryparent

Comments

So a new car, or an AI rig.

That's a bitter pill to swallow. Most of this is the cost of the Nvidia card, and the RAM.

  Graphics:
    (...)
    +$18,399 192 GB Dual NVIDIA RTX PRO 6000 w/ 1000W + 750W PSUs (non-refundable) +$37,239
  Memory:
    (...)
    192 GB DDR5 3600 MHz (4x48) +$1,874 
yup, 87.8% of $42,412 is just two GPUs and a PSU. Even RAM is less than 5%.

Really just the GPUs. PSUs aren’t that expensive maybe 100-200 for a good 750W-1000W one

Kind of feels like if you spend $40K on your GPU setup, you don't want to cheap out on the PSU.

Still, you're right, I have a 1200W PSU for a single RTX Pro 6000, cost ~500 something, so still the PSU shouldn't be that large part of the total budget.

Funny thing is, you don't really want to just plug that into a wall socket. You want an uninterruptible power supply that can keep the machine running for the 5 to 8 minutes you need to get to it and shut it down safely during a power cut.

But you'll find most household power sockets aren't actually rated for the kind of power these things draw at peak. If you go for a dual GPU you're going to want to sustain a higher current. Think washer / drier / fridge kind of hookups for the UPS and that rig.

You spent $42K on the rig, you're also going to need to get an electrician in and have the electrical hookup seen to. The single 4090 I'm running put me right up to that edge where I could use a standard electrical hookup with a 1000w UPS.

So another $1K for the UPS, and $500 worth of electrical work (or more if they have to up the switch to 200 amps, for example).

Not for the faint of wallet.

True enough, depends how good your house electricity panel and wiring is. My basic plugs have 230V x 10A fuses so it would definitely take it to the limit. I also have some 16A which should be fine but I’d have to unplug one of the washing machine or heat pump type things. A 45k machine I would probably run on a UPS like you said. A lot of resistive heating household items use easily 2000W+ so it’s not super exotic but you do need to pay some attention

Kind of feels like if you're noticing $1K here and $500 there, maybe $42K is too much to start with :)

When you start getting into things like this, there's the initial price, then all the pile on of tax and the infrastructure needed to run thing. It's like getting a boat. For a mere $55K you can get a small one... but that is merely the cost of entry.

So you're right. If the $42K price tag didn't make you blink, the additional $2700 in tax, and the $2K to $3K for the work in your house are going to financial hiccups. But it means the cost to start is $50K, not just the price tag.

$42k and a toy CPU at that. Threadripper or EPIC if it must be AMD camp, although I'd rather it weren't (_always_ some random issues on linux). TBH, if I were buying workstation at such prices, I'd probably first take a look at what HP has (since their cooling and immunity to dust is unprecedented), and then probably BOXX and Puget. For DIY there's always supermicro at such levels.

That's what I don't understand, they're shipping RTX 6000s that are PCI lane-starved. Buying a Maserati and driving it around in 3rd gear.

it's probably a fantasy setup, not built nor tested. Or worse, someone there things x8/x8 vs x16 GPUs are 'good enough' for this setup at that price.

I've noticed that some companies have flat out dropped the high memory configurations from their lineup that were offered just months ago at inflated prices. OnePlayerX had a 128GB Strix Halo tablet, RedMagic had a 24GB Android phone - both have been removed from their sites. It's a similar situation for the new Thinkpad lineup.

The honor 400 used to be sold for 300 dollars with 12 gb of ram. Now the replacement the honor 600 comes with 8 GB at twice the price.

SSD too. The priced have tripled...

It would be great if China had more lithography machine....

All memory. SSDs are expensive, microSD is expensive, even spinning rust has inflated.

hoist by our own strategic export controls, rip

Taiwan would disagree

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.