Re: DataNode failed to start due to /usr/lib/hadoop-hdfs/bin/hdfs not exist

2014-03-23 Thread Stanley Shi
seems like a vendor specific problem. Ask this in HDP forum. Regards, *Stanley Shi,* On Mon, Mar 24, 2014 at 9:50 AM, Anfernee Xu wrote: > Hi, > > All dataNode in my cluster failed to start due to below error > > notice: > /Stage[2]/Hdp-hadoop::Datanode/Hdp-hadoop::Service[datanode]/Exec[del

Re: I am about to lose all my data please help

2014-03-23 Thread Stanley Shi
Can you confirm that you namenode image and fseditlog are still there? if not, then your data IS lost. Regards, *Stanley Shi,* On Sun, Mar 23, 2014 at 6:24 PM, Fatih Haltas wrote: > No, not ofcourse I blinded it. > > > On Wed, Mar 19, 2014 at 5:09 PM, praveenesh kumar wrote: > >> Is this prop

RE: Job fails if I change HADOOP_USER_NAME

2014-03-23 Thread Rohith Sharma K S
Hi Ashwin, How I enable debug for AM container logs ? >> Set below configurations changing log level for AM, map and reducer task. >> Default values are INFO. yarn.app.mapreduce.am.log.level mapreduce.map.log.level mapreduce.reduce.log.level and to which location are

DataNode failed to start due to /usr/lib/hadoop-hdfs/bin/hdfs not exist

2014-03-23 Thread Anfernee Xu
Hi, All dataNode in my cluster failed to start due to below error notice: /Stage[2]/Hdp-hadoop::Datanode/Hdp-hadoop::Service[datanode]/Exec[delete_pid_before_datanode_start]/returns: executed successfully notice: /Stage[2]/Hdp-hadoop::Datanode/Hdp-hadoop::Service[datanode]/Hdp::Exec[su - tie -c

Re: About Different versions of Hadoop in a single system

2014-03-23 Thread Nitin Pawar
technically yes ... practically advised not to implement so you need to be very careful with the configuration you did and not to share between setups. a simple mistake and it will cause very bad effect On Sun, Mar 23, 2014 at 11:14 PM, Jyoti Yadav wrote: > > Hi Folks... > > One doubt is just c

About Different versions of Hadoop in a single system

2014-03-23 Thread Jyoti Yadav
Hi Folks... One doubt is just crippling in my mind. i need your opinions in this case.. the doubt is- Can we install and configure two different versions of hadoop in two different user's home directories?? suppose in */home/user1/hadoop-1.2* and in* /home/user2/hadoop-0.20.2

Re: YarnException: Unauthorized request to start container. This token is expired.

2014-03-23 Thread Fengyun RAO
so you think it's related to the CDH version, not a common Hadoop problem? 2014-03-23 18:56 GMT+08:00 Azuryy : > Hi, > Please send to the CDH mail list, you cannot get answer here. > > > Sent from my iPhone5s > > > On 2014年3月23日, at 17:37, Fengyun RAO wrote: > > > > What does this exception mea

Re: Yarn MapReduce Job Issue - AM Container launch error in Hadoop 2.3.0

2014-03-23 Thread Tony Mullins
Ok , my bad , I fixed the issue it was due to bad classpaths. I was not giving complete lib dir paths. Thanks Vinod for your time & help. Regards, Tony On Sat, Mar 22, 2014 at 11:41 PM, Vinod Kumar Vavilapalli < vino...@apache.org> wrote: > Given your earlier mail about the paths in /opt, shou

Re: YarnException: Unauthorized request to start container. This token is expired.

2014-03-23 Thread Azuryy
Hi, Please send to the CDH mail list, you cannot get answer here. Sent from my iPhone5s > On 2014年3月23日, at 17:37, Fengyun RAO wrote: > > What does this exception mean? I googled a lot, all the results tell me it's > because the time is not synchronized between datanode and namenode. > Howeve

Re: I am about to lose all my data please help

2014-03-23 Thread Fatih Haltas
No, not ofcourse I blinded it. On Wed, Mar 19, 2014 at 5:09 PM, praveenesh kumar wrote: > Is this property correct ? > > > > fs.default.name > -BLANKED > > > Regards > Prav > > > On Wed, Mar 19, 2014 at 12:58 PM, Fatih Haltas wrote: > >> Thanks for you helps, but still could not solv

YarnException: Unauthorized request to start container. This token is expired.

2014-03-23 Thread Fengyun RAO
What does this exception mean? I googled a lot, all the results tell me it's because the time is not synchronized between datanode and namenode. However, I checked all the servers, that the ntpd service is on, and the time differences are less than 1 second. What's more, the tasks are not always fa