The MapReduce tasks I run on Hadoop are heavily CPU bound. This would be a dream come true, at least until the light bill arrived. I have to wonder, with so many MR tasks running on a single box, would IO become an issue again? Suppose you have 12 HDDs and 96 tasks running. At some point the tasks are going to fight each other for the needle.
Comments
The MapReduce tasks I run on Hadoop are heavily CPU bound. This would be a dream come true, at least until the light bill arrived. I have to wonder, with so many MR tasks running on a single box, would IO become an issue again? Suppose you have 12 HDDs and 96 tasks running. At some point the tasks are going to fight each other for the needle.