Re: YarnException: Unauthorized request to start container. This token is expired.

2014-04-02 Thread Fengyun RAO
thank you, omkar, I'm fresh to Hadoop, and all the settings are default, so I guess the expiration is 10 minutes. The exception happens when running big job, which occupies all the resources of all nodes. When running small job, with many containers remained, no exception was thrown. Actually

Re: YarnException: Unauthorized request to start container. This token is expired.

2014-04-02 Thread Wangda Tan
Fengyun, I think I have met a similar problem before, you can check if RM's time and NM's time are set synchronized or not. Regards, Wangda Tan On Wed, Apr 2, 2014 at 9:55 PM, Fengyun RAO raofeng...@gmail.com wrote: thank you, omkar, I'm fresh to Hadoop, and all the settings are default, so

Re: YarnException: Unauthorized request to start container. This token is expired.

2014-04-02 Thread Fengyun RAO
I've found the jira page: https://issues.apache.org/jira/browse/YARN-180 though I don't quite understand container reservation. 2014-04-02 21:55 GMT+08:00 Fengyun RAO raofeng...@gmail.com: thank you, omkar, I'm fresh to Hadoop, and all the settings are default, so I guess the expiration is

Re: YarnException: Unauthorized request to start container. This token is expired.

2014-03-29 Thread omkar joshi
Can you check few things? What is the container expiry interval set to? How many containers are getting allocated? Is there any reservation of the containers happening..? if yes then that was a known problem...I don't remember the jira number though... Underlying problem in case of reservation was

Re: YarnException: Unauthorized request to start container. This token is expired.

2014-03-28 Thread Leibnitz
no doubt Sent from my iPhone 6 On Mar 23, 2014, at 17:37, Fengyun RAO raofeng...@gmail.com wrote: What does this exception mean? I googled a lot, all the results tell me it's because the time is not synchronized between datanode and namenode. However, I checked all the servers, that the

YarnException: Unauthorized request to start container. This token is expired.

2014-03-23 Thread Fengyun RAO
What does this exception mean? I googled a lot, all the results tell me it's because the time is not synchronized between datanode and namenode. However, I checked all the servers, that the ntpd service is on, and the time differences are less than 1 second. What's more, the tasks are not always

Re: YarnException: Unauthorized request to start container. This token is expired.

2014-03-23 Thread Azuryy
Hi, Please send to the CDH mail list, you cannot get answer here. Sent from my iPhone5s On 2014年3月23日, at 17:37, Fengyun RAO raofeng...@gmail.com wrote: What does this exception mean? I googled a lot, all the results tell me it's because the time is not synchronized between datanode and

Re: YarnException: Unauthorized request to start container. This token is expired.

2014-03-23 Thread Fengyun RAO
so you think it's related to the CDH version, not a common Hadoop problem? 2014-03-23 18:56 GMT+08:00 Azuryy azury...@gmail.com: Hi, Please send to the CDH mail list, you cannot get answer here. Sent from my iPhone5s On 2014年3月23日, at 17:37, Fengyun RAO raofeng...@gmail.com wrote: