Nested map reduce job

please post it here. All your help is appreciated. Thanks, Venkat -- View this message in context: http://old.nabble.com/Nested-map-reduce-job-tp33763485p33763485.html Sent from the Hadoop core-user mailing list archive at Nabble.com.

RE: Nested map reduce job

You may not need nested map-reduce job. All you need to do is to use keys to partition the permutation. And duplicate the data from map. output.collect(1, value); output.collect(2, value); . . . output.collect(n, value); Then, set your reducer number to n. When you emit data in the mapper

Re: Nested map reduce job

A quick glance at your problem indicates that you might have a design problem with your code. In my opinion you should avoid nested Map/Reduce job. You could use chain Map/Reduce, but the nested or recursive structure is not suggested. I don't know how you implemented your nested M/