Indeed... and as hard as the problem seems, what we think we see is already unlike what hits our retina - the mind fills in blind spots, balances color and detail, patches retinal irregularities, smooths motion, and so forth. The solution will probably use these qualities to its advantage.

(In Oliver Stone's 1993 miniseries Wild Palms, the near-future AR/VR experiences are sometimes enhanced via a hallucinogen/hypnotic called mimezine.)