Comment on AMD Unveils Its First Small Language Model AMD-135MComments−bjt123451y[1] The training code for AMD-135M is based on TinyLlama, utilizing multi-node distributed training with PyTorch FSDP.I thought PyTorch didn't work well with AMD architecture, and read of many people using JAX instead?
Comments
I thought PyTorch didn't work well with AMD architecture, and read of many people using JAX instead?