Re: map side only behavior

2010-01-31 Thread Aaron Kimball
10 10:06 AM > To: common-user@hadoop.apache.org > Subject: Re: map side only behavior > > No, the merge and sort will not happen in mapper task. And each mapper task > will generate one output file. > > > > 2010/1/29 Gang Luo > > > Hi all, > > If I only use

RE: map side only behavior

2010-01-29 Thread Jones, Nick
A single unity reducer should enforce a merge and sort to generate one file. Nick Jones -Original Message- From: Jeff Zhang [mailto:zjf...@gmail.com] Sent: Friday, January 29, 2010 10:06 AM To: common-user@hadoop.apache.org Subject: Re: map side only behavior No, the merge and sort

Re: map side only behavior

2010-01-29 Thread Gang Luo
-user@hadoop.apache.org 发送日期: 2010/1/29 (周五) 11:05:33 上午 主 题: Re: map side only behavior No, the merge and sort will not happen in mapper task. And each mapper task will generate one output file. 2010/1/29 Gang Luo > Hi all, > If I only use map side to process my data (set # of reducers to 0 )

Re: map side only behavior

2010-01-29 Thread Jeff Zhang
No, the merge and sort will not happen in mapper task. And each mapper task will generate one output file. 2010/1/29 Gang Luo > Hi all, > If I only use map side to process my data (set # of reducers to 0 ), what > is the behavior of hadoop? Will it merge and sort each of the spills > generated

map side only behavior

2010-01-29 Thread Gang Luo
Hi all, If I only use map side to process my data (set # of reducers to 0 ), what is the behavior of hadoop? Will it merge and sort each of the spills generated by one mapper? -Gang - 原始邮件 发件人: Gang Luo 收件人: common-user@hadoop.apache.org 发送日期: 2010/1/29 (周五) 8:54:33 上午 主 题: Re: fin