‘But the idea that you’d need explicit self-referentiality before you could get convincing and world-changing conversational intelligence?’ — has anyone ever formulated this actual idea or anything logically equivalent? This looks like a mighty straw man.