Re: hdfs output for both mapper and reducer

2008-09-25 Thread Mice
I think you can try org.apache.hadoop.mapred.lib.MultipleOutputs, it will be released in 0.19 but you can apply the patch now. Just my idea, not sure it's efficient or not 2008/9/25 Christian Ulrik Søttrup <[EMAIL PROTECTED]>: > Hi all, > > I am interested in saving the the output of both the map

hdfs output for both mapper and reducer

2008-09-25 Thread Christian Ulrik Søttrup
Hi all, I am interested in saving the the output of both the mapper and the reducer in HDFS, is there an efficient way of doing this? Of course i could just run the mapper followed by the identity reducer, and then an identity mapper with my reducer. However, it seems like a waste to run the fr