Constantly having someone looking over your shoulder is a world of stress and overstimulation that I (and I suspect many others) will not stand for.

I suspect this is a simple social anxiety you could train away.