It's about control. If a middle manager (or higher) can't see you, they don't believe that you're working. No matter how much work you actually get done.