Re: Re: Question about shuffle/merge/sort phrase

2014-12-22 Thread Srivathsala Chary Vangeepuram
...@163.com > > > > From: Susheel Kumar Gadalay > > Date: 2014-12-22 13:20 > > To: user > > Subject: Re: Question about shuffle/merge/sort phrase > > Sorry, typo > > > > It is the reducer which will pull the mapper o/p as soon as it completes. >

Re: Re: Question about shuffle/merge/sort phrase

2014-12-21 Thread Sandeep Khurana
nodes before reducer see the > ? > > -- > bit1...@163.com > > > *From:* Susheel Kumar Gadalay > *Date:* 2014-12-22 13:20 > *To:* user > *Subject:* Re: Question about shuffle/merge/sort phrase > Sorry, typo > > It is the reducer

Re: Re: Question about shuffle/merge/sort phrase

2014-12-21 Thread Susheel Kumar Gadalay
nodes before reducer see the > ? > > > > bit1...@163.com > > From: Susheel Kumar Gadalay > Date: 2014-12-22 13:20 > To: user > Subject: Re: Question about shuffle/merge/sort phrase > Sorry, typo > > It is the reducer which will pull the mapper o/p as soon as

Re: Re: Question about shuffle/merge/sort phrase

2014-12-21 Thread bit1...@163.com
Then what exactly happens after Reducer pulls all mapper output key/value pairs from all the mapper nodes before reducer see the ? bit1...@163.com From: Susheel Kumar Gadalay Date: 2014-12-22 13:20 To: user Subject: Re: Question about shuffle/merge/sort phrase Sorry, typo It is the reducer

Re: RE: Question about shuffle/merge/sort phrase

2014-12-21 Thread bit1...@163.com
4-12-22 12:23 To: user@hadoop.apache.org Subject: RE: Question about shuffle/merge/sort phrase whose responsibility is it that brings each key with all its values together >> You can set combiner class in your job. For more information , refer http://hadoop.apache.org/docs/current/hadoop-

Re: Question about shuffle/merge/sort phrase

2014-12-21 Thread Susheel Kumar Gadalay
Sorry, typo It is the reducer which will pull the mapper o/p as soon as it completes. On 12/22/14, Susheel Kumar Gadalay wrote: > It is the mapper which will push the o/p to the respective reducer as > soon as it completes. > > The no of reducers are known at the beginning itself. > The mapper a

Re: Question about shuffle/merge/sort phrase

2014-12-21 Thread Susheel Kumar Gadalay
It is the mapper which will push the o/p to the respective reducer as soon as it completes. The no of reducers are known at the beginning itself. The mapper as it process the input split, generate the o/p of for each reducer (if the mapper o/p key is eligible for the reducer). The reducer will wai

RE: Question about shuffle/merge/sort phrase

2014-12-21 Thread Rohith Sharma K S
whose responsibility is it that brings each key with all its values together >> You can set combiner class in your job. For more information , refer http://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html Thanks & Regards Rohith Sharma K S