I found this Intel website [1] more informative regarding architecture and capabilities of Gaudi2:

[1] https://www.intel.com/content/www/us/en/developer/articles/t...