Related note: I wrote a program that collects all the HN, Reddit, and Digg Technology articles and ranks them. It was a fun quickie-project in F#

Instead of stripping the intersection, I find that dupes usually indicate a more important story, so I check on those first.

I find that by indicating relative movement (is the story moving up or down in rankings?) and relative comment change I can get an indication of what's hot or not. Whenever I'm bored and want to do a bunch of reading, I can control-click my way into dozens of useful stories pretty quickly! It was a fun project.

Here's the site if anybody's interested:

http://project-management-methodologies.net