Skip to content

Comment on Unified Memory, Explained: Why Mini PCs Can Run 70B Models a Big GPU Can't

Comments

Put two machines on a desk, each about $2,000. One is a tower with an NVIDIA RTX 5090: 32GB of the fastest consumer memory ever shipped, 1,792 GB/s. The other is a mini PC the size of a paperback, an AMD Ryzen AI Max+ 395 "Strix Halo" box with 128GB of soldered memory at roughly 256 GB/s.

Doesn't change the conclusions of the article, but each of those machines is more like $4k+

https://www.microcenter.com/product/711961/amd-ryzen-ai-halo...

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.