While I haven't read the proof sufficiently in depth to explain it, but these aren't physical spheres because they have infinite parts.

They're less practically offensive to our senses, but I don't think this is really any different from zooming infinitely into a fractal or the difference between countable and uncountable sets. Infinities behave strangely.