Re: 33%, 66%, and 100% *reducer* optimization

2012-10-15 Thread Vinod Kumar Vavilapalli
Reduce has three phases - shuffle, sort and reduce. So, 33% would imply the shuffle phase end, and 66% would refer to the end of sort phase. Thanks, +Vinod On Oct 15, 2012, at 2:32 PM, Jay Vyas wrote: > Hi guys ! > > We all know that there are major milestones in reducers (33%, 66%) > > In p

RE: Problem setting up Hadoop security with active directory using one-way cross-realm configuration

2012-10-15 Thread Guillaume Polaert
It's working. I haven't configured the property hadoop.security.auth_to_local for AD REALM. Guillaume Polaert | Cyrès Conseil -Message d'origine- De : Guillaume Polaert [mailto:gpola...@cyres.fr] Envoyé : lundi 15 octobre 2012 12:08 À : ivan.fr...@gmail.com; common-user@hadoop.apach

wait at the end of job

2012-10-15 Thread Harun Raşit Er
I have a windows hadoop cluster consists of 8 slaves 1 master node. My hadoop program is a collection of recursive jobs. I create 14 map, 14 reduce tasks in each job. My files are up to 10mb. My problem is that all jobs are waiting at the end of job. Map %100 Reduce %100 seen on command prompt but

RE: Problem setting up Hadoop security with active directory using one-way cross-realm configuration

2012-10-15 Thread Guillaume Polaert
Hi Ivan, Did you solve your problem ? I've the same issue. I can run Hadoop commands after a kinit with a "local principal" (@CLUSTER.HADOOP.DEV) but it doesn't work with AD user (@AD.HADOOP.DEV). Could you help me ? Thanks Guillaume Polaert | Cyrès Conseil -Message d'origine- De :