Re: The code for the Shuffle phase of MapReduce

2014-02-13 Thread Tsuyoshi OZAWA
Hi Pramod, In addition to shuffle plugin related parts, please check out how spill works in MapTask.java and how reducer fetches MapOutputs from mappers. Thanks, Tsuyoshi On Mon, Feb 10, 2014 at 2:54 AM, Pramod Biligiri wrote: > Hi, > I'm beginning to look at the code for the Shuff

Re: The code for the Shuffle phase of MapReduce

2014-02-10 Thread Sandy Ryza
Hi Pramod, For the reduce side, also check out Shuffle.java. -Sandy On Mon, Feb 10, 2014 at 2:54 AM, Pramod Biligiri wrote: > Hi, > I'm beginning to look at the code for the Shuffle phase of MapReduce, for > an academic project. > > I wanted to confirm if I have started a

The code for the Shuffle phase of MapReduce

2014-02-10 Thread Pramod Biligiri
Hi, I'm beginning to look at the code for the Shuffle phase of MapReduce, for an academic project. I wanted to confirm if I have started at the right location: I'm looking at a file called ShuffleHandler.java in the hadoop-mapreduce-client-shuffle sub project of hadoop-mapreduce-pro