Comment on Infrastructure setup and open-source scripts to train 70B model from bare metalparentComments−bigiain2yNot likely to work. Not many (any) hobbyists can get 400gbps network throughput between each other's GPUs...
Comments
Not likely to work. Not many (any) hobbyists can get 400gbps network throughput between each other's GPUs...