Skip to content

Comment on Chinese AI Companies Conducting Distillation Campaigns Against U.S. AI Companies [pdf]

Comments

Can someone walk me through exactly how powerful distillation is?

I've never seen a good blog post or metric establishing what % of a new model's "intelligence" can be captured. I'm not disputing the document's claim. Widespread effort at distillation is clear evidence that it is highly effective. I guess I just don't have an intuitive or technical sense for how powerful distillation is.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.