Increasing number of Reducers

2012-03-20 Thread Masoud
Hi all, we have a cluster with 32 machines and running C# version of wordcount program on it. Map phase is done by different machines but Reduce is only done by one machine. Our data is around 7G text data and by using one machine for Reduce phase this job is doing so slowly. Is there any

Re: Increasing number of Reducers

2012-03-20 Thread bejoy . hadoop
number of Reducers Hi all, we have a cluster with 32 machines and running C# version of wordcount program on it. Map phase is done by different machines but Reduce is only done by one machine. Our data is around 7G text data and by using one machine for Reduce phase this job is doing so slowly

Re: Increasing number of Reducers

2012-03-20 Thread Masoud
to any higher value. Sent from BlackBerry® on Airtel -Original Message- From: Masoudmas...@agape.hanyang.ac.kr Date: Tue, 20 Mar 2012 17:52:58 To:common-user@hadoop.apache.org Reply-To: common-user@hadoop.apache.org Subject: Increasing number of Reducers Hi all, we have a cluster with 32

Re: Increasing number of Reducers

2012-03-20 Thread bejoy . hadoop
Date: Tue, 20 Mar 2012 19:49:01 To: common-user@hadoop.apache.org Reply-To: common-user@hadoop.apache.org Subject: Re: Increasing number of Reducers Thanks for reply, as you know in this way we will have n final result too, is this any way to increase the number of Reducer for fast computation