You're neglecting that data costs money and time to collect and process. More data is more cost.
I am in agreement with the spirit of this post (I'm not interested in arguing whether intelligent data is a good term or not.) Heck I even blogged along similar lines just a few days ago: http://noelwelsh.com/streaming-algorithms/2012/08/29/lean-da... Here are a few problems with collecting everything:
- Big Data infrastructure like Hadoop is expensive and slow. It's very much not in the turn-on-a-dime spirit of startups.
- If you collect everything, the value per data item is low. This impacts the analyses you profitably do. Compare the value that Klaviyo can deliver per data point vs, say, Mixpanel. (And then ask yourself why Mixpanel is moving into "People" analytics. My suggestion: because it's much more valuable.)
Disclaimer 1: My startup, Myna [http://mynaweb.com/], had a shout-out in the blog post.
Disclaimer 2: I'm a Klaviyo user, as of a few days ago.
Today the storage of more data is negligible. There are alternatives to Hadoop. However, to capture new variables that exist in your market place definitely takes time and money.
Comments
You're neglecting that data costs money and time to collect and process. More data is more cost.
I am in agreement with the spirit of this post (I'm not interested in arguing whether intelligent data is a good term or not.) Heck I even blogged along similar lines just a few days ago: http://noelwelsh.com/streaming-algorithms/2012/08/29/lean-da... Here are a few problems with collecting everything:
- Big Data infrastructure like Hadoop is expensive and slow. It's very much not in the turn-on-a-dime spirit of startups.
- If you collect everything, the value per data item is low. This impacts the analyses you profitably do. Compare the value that Klaviyo can deliver per data point vs, say, Mixpanel. (And then ask yourself why Mixpanel is moving into "People" analytics. My suggestion: because it's much more valuable.)
Disclaimer 1: My startup, Myna [http://mynaweb.com/], had a shout-out in the blog post.
Disclaimer 2: I'm a Klaviyo user, as of a few days ago.
Today the storage of more data is negligible. There are alternatives to Hadoop. However, to capture new variables that exist in your market place definitely takes time and money.