Comment on Do We Need a New Orchestration System for GPUs?parentComments−zenlikethatOP3yOh yeah, Horde is super cool, I’ve been meaning to give it a spin. That’s good info about the web ui! I have noticed that relative to my hardware, the results seem slow. Lots could be causing that though.−brucethemoose23yAnother factor is your system libs. An old PyTorch/CUDA combo, for instance, can hold 4000 GPUs back.I have been quite happy with Arch's build of PyTorch (which targets CUDA 12.1 at the moment).
Comments
Oh yeah, Horde is super cool, I’ve been meaning to give it a spin. That’s good info about the web ui! I have noticed that relative to my hardware, the results seem slow. Lots could be causing that though.
Another factor is your system libs. An old PyTorch/CUDA combo, for instance, can hold 4000 GPUs back.
I have been quite happy with Arch's build of PyTorch (which targets CUDA 12.1 at the moment).