I like this analogy. I would say that culture is actually part of "do you like who you're working with," though. "I don't like the culture" is a way of saying "I don't like management" or "I don't like my peers."

If your immediate peers are great, but the organization doesn't support your getting training, makes you dress up, makes you keep timesheets, requires TPS reports and long meetings, etc, those decisions are being made by people. And they are being annoying (even if they're otherwise nice).