Hi Deepak, AFAIK, the number of output files depends on the number of reduce tasks (i hope i'm not missing any other factors). So, If a single output file is the requirement, then setting number of reduce tasks to 1 should work. Another solution would be to put another job with these output files as input and merge them.
Hope this helps, Chaitanya. On Thu, Jul 29, 2010 at 12:46 AM, Deepak Diwakar <[email protected]>wrote: > I have setup 2 node clusters and ran many jobs including wordcount. In all > the output folders i am getting two mutual exclusive output files as > part-00000 and part-00001 instead of single output. A merging should take > place to get into one single output file which is not occurring here . > > Could someone point me out where i am going wrong? > > Thanks & regards > - Deepak Diwakar, >
