Comment on Intel Gaudi2 chips outperform Nvidia H100 on diffusion transformersparentComments−ABS2y"Announced" 2 years ago is different from its availability and ability:- Intel acquired Habana in 2019- Habana launched Gaudi2 in 2022- only in H2 2023 Habana enabled FP8 which delivered around 100% improvement in time-to-trainOn the rest I believe you but markets don't move based on single individual's/company's data points−memossyOP2yGaudi2s started coming out in 2022 (https://huggingface.co/blog/habana-gaudi-2-benchmark) but didn't hit mass scale. I think Gaudi3 will & others have seen similar performance for Gaudi2 eg Databricks: https://www.databricks.com/blog/llm-training-and-inference-i..., mlperf etcWe are about to drop stable diffusion 3 which is the best image model out there (https://x.com/EMostaque/status/1764941367682256950?s=20) with similar architecture to Sora by OpenAI that can be used for any modality.We have hundreds of millions of downloads of our models so are looking for big scale as we move to every pixel being generated & this stuff goes from research to mass deployment.
Comments
"Announced" 2 years ago is different from its availability and ability:
- Intel acquired Habana in 2019
- Habana launched Gaudi2 in 2022
- only in H2 2023 Habana enabled FP8 which delivered around 100% improvement in time-to-train
On the rest I believe you but markets don't move based on single individual's/company's data points
Gaudi2s started coming out in 2022 (https://huggingface.co/blog/habana-gaudi-2-benchmark) but didn't hit mass scale. I think Gaudi3 will & others have seen similar performance for Gaudi2 eg Databricks: https://www.databricks.com/blog/llm-training-and-inference-i..., mlperf etc
We are about to drop stable diffusion 3 which is the best image model out there (https://x.com/EMostaque/status/1764941367682256950?s=20) with similar architecture to Sora by OpenAI that can be used for any modality.
We have hundreds of millions of downloads of our models so are looking for big scale as we move to every pixel being generated & this stuff goes from research to mass deployment.