It's easy to say all this in hindsight, but humans are actually not very good at extracting valid patterns from large masses of data. Yet we more and more need to do so.

Kaggle has taken an important niche and created a market for buyers and sellers. I was skeptical when I first saw it mentioned but then, I'm usually amazed when anything succeeds. :D