Skip to content

Comment on AMD Strix Halo RDMA Cluster Setup Guideparent

Comments

Yes CX5 can offload more. I believe CX4 has similar offloading capabilities as CX3, except that it supports 100G.

Another note: In my experience, RoCE works much better on CX4+ generation. CX3 is best with Infiniband. I think some firmwares on the CX3 generation, has a messed up config for RoCE. But running Infiniband is not a complex task, is way easier than people think, like 10x easier and faster to setup than Ethernet.

Thanks. Yes, I'm using Infiniband with CX3. Not seeing real speedups so far. I was wondering if upgrading to CX5 could help.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.