That's because one doesn't usually look at their watch to find out what the time is: most of the time (pun unintended) we want to how much time is left for an activity, or for an activity to start.

As in, how many more minutes before my flight takes off, or how much time left for this exam?