Skip to content

Comment on AMD Strix Halo RDMA Cluster Setup Guideparent

Comments

Are they fairly reasonable performance from your experience?

I'm about to move house and one of the things I want is better local AI. Ideally running a variety of smaller models at the same time, but occasionally one larger one. 128GB unified is pretty appealing, but for the price I can also get a handful of 5060 ti 16GB which give vastly better compute/inference speed.

Seen a few reviews of the strix halo boards from people complaining the tps is too low so definitely keen to hear others' experiences with em.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.