The argument is that single-layer networks would need to be impractically wide to have the same representational power as a narrower network with multiple layers.
I haven't looked into the math myself, but apparently there are situations where the increase in representational power for networks of a given size can be increased exponentially by moving nodes into higher layers.
Comments
The argument is that single-layer networks would need to be impractically wide to have the same representational power as a narrower network with multiple layers.
I haven't looked into the math myself, but apparently there are situations where the increase in representational power for networks of a given size can be increased exponentially by moving nodes into higher layers.