Have you done the math? Under a revenue-neutral shift that taxes buildings less and land more, the median homeowner comes out ahead:

https://landeconomics.org/reports/spokane-report

I think what you're missing is that land in the wealthiest parts of town is worth exponentially more than land out in the suburbs