Uhh.... I have a box with two AMD Radeon AI PRO R9700 32GB.
It was the most trouble-free AI setup that I have done. The driver worked right out of the box with the stock Fedora kernel, ROCM can be installed from the regular repo, and most AI software has ROCM builds by now.
Recently: running Laguna-S with reasonable speed. Before that, I was able to run multiple Qwens or a Qwen and several copies of a smaller model for subagents.
The cards that I have are not loud at all. The cards are capped at 300W each, so that's really not that much heat to move.
Comments
Uhh.... I have a box with two AMD Radeon AI PRO R9700 32GB.
It was the most trouble-free AI setup that I have done. The driver worked right out of the box with the stock Fedora kernel, ROCM can be installed from the regular repo, and most AI software has ROCM builds by now.
What can you do with "only" 64G of VRAM that a 32G can't? Also, the R9700 are so loud!
Recently: running Laguna-S with reasonable speed. Before that, I was able to run multiple Qwens or a Qwen and several copies of a smaller model for subagents.
The cards that I have are not loud at all. The cards are capped at 300W each, so that's really not that much heat to move.