Skip to content

Comment on Renormalization: A Common Logic to Seeing Cats and Cosmosparent

Comments

The argument is that single-layer networks would need to be impractically wide to have the same representational power as a narrower network with multiple layers.

I haven't looked into the math myself, but apparently there are situations where the increase in representational power for networks of a given size can be increased exponentially by moving nodes into higher layers.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.