Comment on Proxmox VE now available for ARM64Comments−ece1moThis would be interesting on a Spark or two. I don't know how seamless the GPU and networking cluster setup would be when resource sharing between agent and post-training VMs.−moondev1moUnfortunately as of today DGX Spark doesn't support GPU PCI passrhru for KVMA good alternative is incus and running LXC and or OCI containers, GPU works in those and can be shared with multiple instances
Comments
This would be interesting on a Spark or two. I don't know how seamless the GPU and networking cluster setup would be when resource sharing between agent and post-training VMs.
Unfortunately as of today DGX Spark doesn't support GPU PCI passrhru for KVM
A good alternative is incus and running LXC and or OCI containers, GPU works in those and can be shared with multiple instances