I've created a number of social sites and I've come to the conclusion that down-voting should not generally be allowed/used. The reason is that 9 times out of 10 it's used as a way to say "I disagree with this" regardless of the quality or accuracy of the item in question. Usually based solely on political and religious world-views.

This effect is probably muted on SO which is primarily technical.