Show HN: Hardware-software co-design for MoE models to bypass NCCL bottlenecksgithub.com/PJHkorea 3 pointsPJHkorea1 month ago1 commentSaveHideCopy link On HNComments−PJHkoreaOP1moImagine virtual memory, but instead of using your local storage, you’re pooling a whole bunch of network servers into a single address space
Comments
Imagine virtual memory, but instead of using your local storage, you’re pooling a whole bunch of network servers into a single address space