RE: Reduce > copy at 0.00 MB/s

2012-02-01 Thread sathyavageeswaran
Can somebody help me to unsubscribe. Even after unsubscribing I continue to get mails. -Original Message- From: hadoop hive [mailto:hadooph...@gmail.com] Sent: 02 February 2012 12:29 To: common-user@hadoop.apache.org Subject: Re: Reduce > copy at 0.00 MB/s Hey , Can any1 help me w

Re: Reduce > copy at 0.00 MB/s

2012-02-01 Thread hadoop hive
Hey , Can any1 help me with this, i have increases the reduce slowstart to .25 but its still hangs after copy . tell me what else i can change it to make it working fine. regards Vikas Srivastava On Wed, Jan 25, 2012 at 7:45 PM, praveenesh kumar wrote: > Yeah , I am doing it, currently its on 2

Re: Reduce > copy at 0.00 MB/s

2012-01-25 Thread praveenesh kumar
Yeah , I am doing it, currently its on 20 %, I guess I have to raise it more. Funny thing is, its still happening after map is 100% completed. when map is completed, it should not wait, right. But I see it still give same message, for some time. Thanks, Praveenesh On Wed, Jan 25, 2012 at 7:29 PM,

Re: Reduce > copy at 0.00 MB/s

2012-01-25 Thread Harsh J
The copy phase fetches the map outputs. It may hang for a while if there are no newly completed map outputs to fetch yet. You can raise your reducers' slowstart value to have it not spend so many cycles waiting but rather start at 80-90% of map completions, instead of default 5%. This helps your M

Re: Reduce > copy at 0.00 MB/s

2012-01-25 Thread hadoop hive
this problem arise after adding a node , so then i start balancer to make it balance , On Wed, Jan 25, 2012 at 4:38 PM, praveenesh kumar wrote: > @hadoophive > > Can you explain more by "balance the cluster" ? > > Thanks, > Praveenesh > > On Wed, Jan 25, 2012 at 4:29 PM, hadoop hive wrote: > > >

Re: Reduce > copy at 0.00 MB/s

2012-01-25 Thread praveenesh kumar
@hadoophive Can you explain more by "balance the cluster" ? Thanks, Praveenesh On Wed, Jan 25, 2012 at 4:29 PM, hadoop hive wrote: > i face the same issue but after sumtime when i balanced the cluster the > jobs started running fine, > > On Wed, Jan 25, 2012 at 3:34 PM, praveenesh kumar >wrot

Re: Reduce > copy at 0.00 MB/s

2012-01-25 Thread hadoop hive
i face the same issue but after sumtime when i balanced the cluster the jobs started running fine, On Wed, Jan 25, 2012 at 3:34 PM, praveenesh kumar wrote: > Hey, > > Can anyone explain me what is reduce > copy phase in the reducer section ? > The (K,List(V)), is passed to the reducer. Is reduce

Reduce > copy at 0.00 MB/s

2012-01-25 Thread praveenesh kumar
Hey, Can anyone explain me what is reduce > copy phase in the reducer section ? The (K,List(V)), is passed to the reducer. Is reduce > copy representing copying of K,List(V) on the reducer from all mappers ? I am monitoring my jobs on the cluster, using Jobtracker url. I am seeing for most of my