Short version: affordable housing is illegal to build.

A bunch of people sit around thinking "Wouldn't rooftop gardens be nice? Hey, let's make it a law that you have to build them on all new towers!". And then they are surprised that the housing costs more and excludes lower-middle class.