Hey Sean,
Check out http://www.slideshare.net/jhammerb/hadoop-map-reduce-arch-106883,
a slightly dated and MR1-oriented presentation from Owen O'Malley that
goes a good level in-depth to get an overview of how things work
(including how reduces pull data).
After that, check out Chris Douglas'
htt
-sb
-Original Message-
From: Harsh J [mailto:ha...@cloudera.com]
Sent: Tuesday, June 05, 2012 7:43 PM
To: common-user@hadoop.apache.org
Subject: Re: Shuffle/sort
Hey Sean,
Check out http://www.slideshare.net/jhammerb/hadoop-map-reduce-arch-106883,
a slightly dated and MR1-oriented
> From: Harsh J [mailto:ha...@cloudera.com]
> Sent: Tuesday, June 05, 2012 7:43 PM
> To: common-user@hadoop.apache.org
> Subject: Re: Shuffle/sort
>
> Hey Sean,
>
> Check out http://www.slideshare.net/jhammerb/hadoop-map-reduce-arch-106883,
> a slightly dated and MR1-orient
So I'm assuming that there is a push side also? Is it part of the map output?
-sb
-Original Message-
From: Harsh J [mailto:ha...@cloudera.com]
Sent: Wednesday, June 06, 2012 9:33 AM
To: common-user@hadoop.apache.org
Subject: Re: Shuffle/sort
Sean,
Yes thats the one for the shu
wrote:
> So I'm assuming that there is a push side also? Is it part of the map output?
> -sb
>
> -Original Message-
> From: Harsh J [mailto:ha...@cloudera.com]
> Sent: Wednesday, June 06, 2012 9:33 AM
> To: common-user@hadoop.apache.org
> Subject: Re: Shuffle/
9:39 AM
To: common-user@hadoop.apache.org
Subject: Re: Shuffle/sort
No (sorry if I confused) the outputs are pulled from TaskTrackers'
HTTP server, which access the local (mapred.local.dir) file outputs from maps,
and serve it to the requester (reduce process). There is no 'push'
