The point about displacing people and businesses is only true if real estate is in a fixed quantity. When building is a possibility this is not a zero sum game.

Given the (OP) solution, I was imagining having a broccoli wall in my apartment. This would give me a lot more insight into the farming practices as I would be growing it. Also, near zero transportation externalities.