There is absolutely demand for affordable housing in desirable parts of the city. It's not that people want denser living, they want to live in a nice part of the city. Way out east of the river is not a great place to live or work for a variety of reasons.

(And, obviously, there are tall office buildings in Rosslyn just over the bridge from DC.)