I am guessing someone who is deaf could win at the challenge.

I have spent time in Anechoic chambers for doing noise level and vibration testing on equipment. They are disconcerting for sure, but I have to imagine someone who never hears anything would not be disoriented.

The shape of the walls messes with me I think more than the sound. We aren't used to not having flat surfaces to judge distance against and not having anything that is only "one" distance away definitely works the part of the brain that does depth perception.