RE: Application Master waits a long time after Mapper/Reducers finish

2015-07-20 Thread Rohith Sharma K S
Hi From thread dump, it seems waiting for HDFS operation. Can you attach AM logs, and do you see any client retry for connecting to HDFS? "CommitterEvent Processor #4" prio=10 tid=0x0199a800 nid=0x18df in Object.wait() [0x7f4f12aa4000] java.lang.Thread.State: WAITING (on object

Re: Application Master waits a long time after Mapper/Reducers finish

2015-07-20 Thread Ashish Kumar Singh
Hi Rohit , Thanks for replying . No , I do not see any connection retry attempts to HDFS in the logs . Also , Namenode and HDFS look healthy in our cluster . PFA latest AM logs for the job . Regards, Ashish On Mon, Jul 20, 2015 at 3:29 PM, Rohith Sharma K S < rohithsharm...@huawei.com> wrot

Re: Application Master waits a long time after Mapper/Reducers finish

2015-07-20 Thread Jianfeng (Jeff) Zhang
gt;" mailto:user@hadoop.apache.org>> Date: Monday, July 20, 2015 at 4:06 AM To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>" mailto:user@hadoop.apache.org>> Subject: Re: Application Master waits a long time after Mapper/Reducers finish Hi Rohit , Than