If one person works late then other people have to match them

or risk being seen as working less hard as that person.

You missed a pretty important bit.