X11 was designed at a time when local networks carried only a few megabits per second. But apps back then didn't depend on sending lots of bitmaps over the wire, just mostly drawing primitives.