This is probably getting a tad too complicated but having a number of different 'upvote' icons (ala Slashdot) would be interesting.

You could upvote someone for being funny, informative, insightful, and so on.

If someone has a high karma for being funny in topics related to computer security, you probably wouldn't trust their security advice so much.