Comment on Infrastructure setup and open-source scripts to train 70B model from bare metalComments−renewiltord2yThis is hella cool. Cisco has a new nvidia collab with 800G per-port. I don’t recall if it was RoCE or not. The infiniband is accessible by the GPUs here? Beautiful.Thank you for sharing all this. One of the more directly useful posts.
Comments
This is hella cool. Cisco has a new nvidia collab with 800G per-port. I don’t recall if it was RoCE or not. The infiniband is accessible by the GPUs here? Beautiful.
Thank you for sharing all this. One of the more directly useful posts.