Skip to content

Comment on Surviving Data Science at the Speed of Hypeparent

Comments

I think that the disruptions are : - Twill with everything (inc unikernels) under Yarn (or Mesos) - The Machine (if it's real) - Datacentre scale integration (so things like 500 different processors in each u which are powered up by the fabric manager to efficiently meet the workload at hand)

I think any vendor who wants to compete with the Open-Source/commodity world will need to do as well as / better than the above to get anywhere!

Programming MR is all done - I wrote MR in Java in 2008->12; never will I again as it's rdd's, transformations and actions now, and it's dead easy (MR is too but the API wasn't)!

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.