Another option would be to have a hidden karma impact on sorting. Keeping a hidden score based on the log(karma) of the up voters might dilute the impact of people until they have been around for a while and help maintain the current culture without ignoring new opinions.