Re: Where the output of mappers are saved ?

2014-12-16 Thread Abdul Navaz
tant University of Houston Main Campus, Houston TX From: "bit1...@163.com" Reply-To: Date: Tuesday, December 16, 2014 at 2:12 AM To: user Subject: Re: Re: Where the output of mappers are saved ? Thanks Susheel !, understood. bit1...@163.com > > From: Susheel Kumar Ga

Re: Re: Where the output of mappers are saved ?

2014-12-16 Thread bit1...@163.com
Thanks Susheel !, understood. bit1...@163.com From: Susheel Kumar Gadalay Date: 2014-12-16 15:27 To: user Subject: Re: Re: Where the output of mappers are saved ? I don't think so. It will be a single output file per reducer. If u want multiple small size output files then specif

Re: Re: Where the output of mappers are saved ?

2014-12-15 Thread Susheel Kumar Gadalay
y, 2G, will the > file be splitted into more files under the output directory,that is, one > reducer could product more than one files. > > > > bit1...@163.com > > From: Susheel Kumar Gadalay > Date: 2014-12-16 14:17 > To: user > Subject: Re: Re: Where the output o

Re: Re: Where the output of mappers are saved ?

2014-12-15 Thread bit1...@163.com
: Re: Re: Where the output of mappers are saved ? Yes, the map outputs will be cleaned on job completion. If u want to see the map outputs give number of reducers as zero and verify the files part-m-, part-m-0001 On 12/16/14, bit1...@163.com wrote: > Do they only exist during the

Re: Re: Where the output of mappers are saved ?

2014-12-15 Thread Susheel Kumar Gadalay
the MR finished? > > When the reduce finished,I only see part-m-, part-m-0001 , which > are reduce results. > > > > bit1...@163.com > > From: Susheel Kumar Gadalay > Date: 2014-12-16 13:05 > To: user > Subject: Re: Where the output of mappers are saved ? >

Re: Re: Where the output of mappers are saved ?

2014-12-15 Thread bit1...@163.com
Thanks. > > > From: Abdul Navaz > Date: Friday, December 12, 2014 at 12:36 AM > To: "user@hadoop.apache.org" > Subject: Where the output of mappers are saved ? > > Hello, > > > I am interested in efficiently manage the Hadoop shuffling traffic and &g

Re: Where the output of mappers are saved ?

2014-12-15 Thread Susheel Kumar Gadalay
; From: Abdul Navaz > Date: Friday, December 12, 2014 at 12:36 AM > To: "user@hadoop.apache.org" > Subject: Where the output of mappers are saved ? > > Hello, > > > I am interested in efficiently manage the Hadoop shuffling traffic and > utilize the network

Re: Where the output of mappers are saved ?

2014-12-15 Thread Abdul Navaz
bytes Thanks. From: Abdul Navaz Date: Friday, December 12, 2014 at 12:36 AM To: "user@hadoop.apache.org" Subject: Where the output of mappers are saved ? Hello, I am interested in efficiently manage the Hadoop shuffling traffic and utilize the network bandwidth effectively. To

Where the output of mappers are saved ?

2014-12-11 Thread Abdul Navaz
Hello, I am interested in efficiently manage the Hadoop shuffling traffic and utilize the network bandwidth effectively. To do this I want to know how much shuffling traffic generated by each Datanodes ? Shuffling traffic is nothing but the output of mappers. So where this mapper output is saved