10 10:06 AM
> To: common-user@hadoop.apache.org
> Subject: Re: map side only behavior
>
> No, the merge and sort will not happen in mapper task. And each mapper task
> will generate one output file.
>
>
>
> 2010/1/29 Gang Luo
>
> > Hi all,
> > If I only use
A single unity reducer should enforce a merge and sort to generate one file.
Nick Jones
-Original Message-
From: Jeff Zhang [mailto:zjf...@gmail.com]
Sent: Friday, January 29, 2010 10:06 AM
To: common-user@hadoop.apache.org
Subject: Re: map side only behavior
No, the merge and sort
-user@hadoop.apache.org
发送日期: 2010/1/29 (周五) 11:05:33 上午
主 题: Re: map side only behavior
No, the merge and sort will not happen in mapper task. And each mapper task
will generate one output file.
2010/1/29 Gang Luo
> Hi all,
> If I only use map side to process my data (set # of reducers to 0 )
No, the merge and sort will not happen in mapper task. And each mapper task
will generate one output file.
2010/1/29 Gang Luo
> Hi all,
> If I only use map side to process my data (set # of reducers to 0 ), what
> is the behavior of hadoop? Will it merge and sort each of the spills
> generated
Hi all,
If I only use map side to process my data (set # of reducers to 0 ), what is
the behavior of hadoop? Will it merge and sort each of the spills generated by
one mapper?
-Gang
- 原始邮件
发件人: Gang Luo
收件人: common-user@hadoop.apache.org
发送日期: 2010/1/29 (周五) 8:54:33 上午
主 题: Re: fin