Skip to content

Comment on Nemotron-4-340B

Comments

"...and were sized to fit on a single DGX H100 with 8 GPUs when deployed in FP8 precision"

OK I see the goal is to sell more H100s, they made it big enough so it's not compatible with a cheaper GPU

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.