in order to increase housing prices for their own private investment benefit.

I think its more that most people just don't like change and want their neighborhoods to remain the same

If they really just wanted to increase their investments, up-zoning greatly increases the value of existing land in most cases.