please post
it here.
All your help is appreciated.
Thanks,
Venkat
--
View this message in context:
http://old.nabble.com/Nested-map-reduce-job-tp33763485p33763485.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.
You may not need nested map-reduce job.
All you need to do is to use keys to partition the permutation. And duplicate
the data from map.
output.collect(1, value);
output.collect(2, value);
.
.
.
output.collect(n, value);
Then, set your reducer number to n. When you emit data in the mapper
A quick glance at your problem indicates that you might have a design
problem with your code. In my opinion you should avoid nested Map/Reduce
job. You could use chain Map/Reduce, but the nested or recursive
structure is not suggested. I don't know how you implemented your
nested M/