seemingly pointless refactoring, instead of tackling issues that are actually important to users

its not a dichotomy. Xorg was built on X11R6, a platform that was written circa 1993. You cannot "tackle issues important to users" based on an outdated stack. They were painted into numerous corners that only a rewrite would fix.