most of the photons will traverse it undisturbed

But then why is the speed of light in glass smaller than in vacuum?