How are those times not arbitrary? Midday is not the middle of the day if you don't wake up at 4 o clock, 14:00 or 14:30 is about the middle of the day.

We could shift the hours for work and life, such that it'd be normal to wake up at 4:30, to have lunch at 10, the sun to reach its peak at 12, the middle of the day etc... But that would be a global, massive effort, requiring a rewrite of conventions that go back centuries. Or we could change the clock instead, making the connection between the number on the clock and the sun a little more arbitrary and giving us a few more hours sunlight at convenient times