Comment on Intel Gaudi2 chips outperform Nvidia H100 on diffusion transformersparentComments−renewiltord2yWhich TPUs do you use? Cloud-hosted or your own hardware? Interesting insight.−1024core2y"TPUs" are a Google-only product, available* only on GCP.* Notwithstanding the Choral boards−MasterScrat2yWe started on V3s, now fully moved to V4s with some V5Es, investigating a full move towards V5E & V5P−memossyOP2yWe use v4s, v5es & v5ps. Mostly v5ps, very stable int8 training (versus the horror that is fp8 stability)
Comments
Which TPUs do you use? Cloud-hosted or your own hardware? Interesting insight.
"TPUs" are a Google-only product, available* only on GCP.
* Notwithstanding the Choral boards
We started on V3s, now fully moved to V4s with some V5Es, investigating a full move towards V5E & V5P
We use v4s, v5es & v5ps. Mostly v5ps, very stable int8 training (versus the horror that is fp8 stability)