Skip to content

Comment on Megatron-Turing NLG 530B, the World’s Largest Generative Language Model

Comments

Any idea if they’ll release an API similar to GPT-3? It’s great that larger and larger models are trained but without enabling access to the trained models developers are left out from the progress…

I hope they don’t release an API the way they released an API for GPT-3.

Why? What do you do not like about GPT-3 API?

Can't fine tune it. Can't use it on private data. Pay per symbol. High latency access. Inconsistent performance. No internet disconnected use. Can't guarentee repeatable results. Can't (easily) replace the sampling with alternatives that have different behavior (e.g. for using it for compression).

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.