You can read the motivation for this technology here: http://ceo.newsbasis.com/try-newscatcher-our-built-in-real-t...

It's built on rails, node.js, resque, and solr