Further, when dealing with psychological or (many) sociological/biological subjects where you can not do a double blind test for moral reasons and all data is anecdotal (ie. self-reported), don't researchers overlook this bit of conventional wisdom?

In fact, from my experience (haha), it seems that people use anecdotal evidence whenever it helps them or supports a popular opinion, but then demand stronger evidence when it goes against their current belief.