> I can't help but consider the logic of the world that's being described

Focusing your attention on the mechanical logic of a story's world is one lens by which to analyze it, but that is a choice and you can choose to analyze it from other lenses as well. Being able to apply multiple perspectives to anything is a useful skill to practice instead of tacitly accepting the view that comes most easily to us.