Cloudera, Hortonworks, and Pivotal are shaping up to be possible contenders and most of the large players are pretty openly announcing that they're planning IPOs. Big Data platforms are a lot like OSes in how they'll schedule jobs and allocate resources for you across nodes. What's bothered me a lot about these stacks is how significant the overhead is and how little really technical work has gone into them like we had developing kernels from the 70s to even today. Most Big Data articles are... not exactly meant for developers while mostly engineers cared about OS design back even to the early 90s as Windows v. Macs v. OS/2 wars still were argued.
Comments
Cloudera, Hortonworks, and Pivotal are shaping up to be possible contenders and most of the large players are pretty openly announcing that they're planning IPOs. Big Data platforms are a lot like OSes in how they'll schedule jobs and allocate resources for you across nodes. What's bothered me a lot about these stacks is how significant the overhead is and how little really technical work has gone into them like we had developing kernels from the 70s to even today. Most Big Data articles are... not exactly meant for developers while mostly engineers cared about OS design back even to the early 90s as Windows v. Macs v. OS/2 wars still were argued.