> The unfortunate thing is that there is no popular open source implementation of a multicore mapreduce

Not popular, I'd agree, but I have had a lot of success with one-off Akka projects. My mappers and reducers are usually under 10 lines of Scala (more if I'm stuck writing Java, obviously).