Your description of "busy people" == insane to 99% of the population, so what he said: "...no sane woman is going to join you" is essentially true.

But yes, insane people should date other insane people. Nobody else will understand them.