Yeah, it does take you into a "what does time mean" rabbit hole. The sun is highly consistent, but that's not the same as convenient - we prefer to divide time into equal units, and leave the rotations of the earth to the International Earth Rotation Service.