moondistance on Llama 405B 506 tokens/second on an H200 · Hackerly

Skip to content

Top New Best Ask Show Jobs

Top New Best Ask Show Jobs

Comment on Llama 405B 506 tokens/second on an H200

Comments

moondistanceOP1y

Significant further optimizations. FP8!

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.