in office chatter I'm constantly picking up bits of sound that make my brain think I should be paying attention to them

Agree. I found that hearing my boss on one side of a phone call where they referenced me or my work in some way was very distracting. What had happened? What was going to happen? What was I potentially being committed to?