DataNode failed to start due to /usr/lib/hadoop-hdfs/bin/hdfs not exist

2014-03-23 Thread Anfernee Xu
Hi,

All dataNode in my cluster failed to start due to below error

notice: 
/Stage[2]/Hdp-hadoop::Datanode/Hdp-hadoop::Service[datanode]/Exec[delete_pid_before_datanode_start]/returns:
executed successfully
notice: 
/Stage[2]/Hdp-hadoop::Datanode/Hdp-hadoop::Service[datanode]/Hdp::Exec[su
- tie -c  'export HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec &&
/usr/lib/hadoop/sbin/hadoop-daemon.sh --config /etc/hadoop/conf start
datanode']/Exec[su - tie -c  'export
HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec &&
/usr/lib/hadoop/sbin/hadoop-daemon.sh --config /etc/hadoop/conf start
datanode']/returns: starting datanode, logging to
/var/log/hadoop/tie/hadoop-tie-datanode-slc01ghq.out
notice: 
/Stage[2]/Hdp-hadoop::Datanode/Hdp-hadoop::Service[datanode]/Hdp::Exec[su
- tie -c  'export HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec &&
/usr/lib/hadoop/sbin/hadoop-daemon.sh --config /etc/hadoop/conf start
datanode']/Exec[su - tie -c  'export
HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec &&
/usr/lib/hadoop/sbin/hadoop-daemon.sh --config /etc/hadoop/conf start
datanode']/returns: nice: /usr/lib/hadoop-hdfs/bin/hdfs: No such file
or directory


How this happened? it turned out hadoop-hdfs was not installed, the issue
was fixed by yum install hadoop-hdfs

-- 
--Anfernee


Re: DataNode failed to start due to /usr/lib/hadoop-hdfs/bin/hdfs not exist

2014-03-23 Thread Stanley Shi
seems like a vendor specific problem. Ask this in HDP forum.

Regards,
*Stanley Shi,*



On Mon, Mar 24, 2014 at 9:50 AM, Anfernee Xu  wrote:

> Hi,
>
> All dataNode in my cluster failed to start due to below error
>
> notice: 
> /Stage[2]/Hdp-hadoop::Datanode/Hdp-hadoop::Service[datanode]/Exec[delete_pid_before_datanode_start]/returns:
>  executed successfully
> notice: 
> /Stage[2]/Hdp-hadoop::Datanode/Hdp-hadoop::Service[datanode]/Hdp::Exec[su - 
> tie -c  'export HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec && 
> /usr/lib/hadoop/sbin/hadoop-daemon.sh --config /etc/hadoop/conf start 
> datanode']/Exec[su - tie -c  'export 
> HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec && 
> /usr/lib/hadoop/sbin/hadoop-daemon.sh --config /etc/hadoop/conf start 
> datanode']/returns: starting datanode, logging to 
> /var/log/hadoop/tie/hadoop-tie-datanode-slc01ghq.out
> notice: 
> /Stage[2]/Hdp-hadoop::Datanode/Hdp-hadoop::Service[datanode]/Hdp::Exec[su - 
> tie -c  'export HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec && 
> /usr/lib/hadoop/sbin/hadoop-daemon.sh --config /etc/hadoop/conf start 
> datanode']/Exec[su - tie -c  'export 
> HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec && 
> /usr/lib/hadoop/sbin/hadoop-daemon.sh --config /etc/hadoop/conf start 
> datanode']/returns: nice: /usr/lib/hadoop-hdfs/bin/hdfs: No such file or 
> directory
>
>
> How this happened? it turned out hadoop-hdfs was not installed, the issue
> was fixed by yum install hadoop-hdfs
>
> --
> --Anfernee
>