Sumit Mohanty created AMBARI-2076:
-------------------------------------
Summary: DataNode install failed with custom users
Key: AMBARI-2076
URL: https://issues.apache.org/jira/browse/AMBARI-2076
Project: Ambari
Issue Type: Bug
Affects Versions: 1.3.0
Reporter: Sumit Mohanty
Assignee: Sumit Mohanty
Fix For: 1.3.0
1) Using latest QA build
2) Modified all log and pid directories (just added an 'xx' to all props)
3) Modified all user accounts (just added an 'xx' to all props) – see screen
shot
4) Install failed error below on the datanode install
stderr:
none
none
stdout:
notice: /Stagemain/Hdp-repos::Process_repo/FileHDP/ensure: defined content as '
{md5}e4521dbc3c19e73cef603cd7d2a7f1b0'
notice: Finished catalog run in 0.11 seconds
notice: /Stagemain/Hdp-repos::Process_repo/FileHDP-epel/ensure: defined content
as '{md5}
e9b95c5b568ee24769f8d0f851acade2'
notice: Finished catalog run in 0.05 seconds
warning: Dynamic lookup of $ambari_db_rca_url is deprecated. Support will be
removed in Puppet 2.8. Use a fully-qualified variable name (e.g.,
$classname::variable) or parameterized classes.
warning: Dynamic lookup of $ambari_db_rca_driver is deprecated. Support will be
removed in Puppet 2.8. Use a fully-qualified variable name (e.g.,
$classname::variable) or parameterized classes.
warning: Dynamic lookup of $ambari_db_rca_username is deprecated. Support will
be removed in Puppet 2.8. Use a fully-qualified variable name (e.g.,
$classname::variable) or parameterized classes.
warning: Dynamic lookup of $ambari_db_rca_password is deprecated. Support will
be removed in Puppet 2.8. Use a fully-qualified variable name (e.g.,
$classname::variable) or parameterized classes.
notice: /Stage1/Hdp::Create_smoke_user/Groupusersxx/ensure: created
notice: /Stage1/Hdp/Grouphadoopxx/ensure: created
notice: /Stage1/Hdp::Create_smoke_user/Hdp::Userambari-qa/Userambari-qa/ensure:
created
notice: /Stage1/Hdp::Create_smoke_user/Hdp::Execusermod -u 1012
ambari-qa/Execusermod -u 1012 ambari-qa/returns: executed successfully
notice:
/Stage1/Hdp::Snappy::Package/Hdp::Packagesnappy/Hdp::Package::Process_pkgsnappy/Packagesnappy/ensure:
created
notice:
/Stage1/Hdp::Snmp/Hdp::Packagesnmp/Hdp::Package::Process_pkgsnmp/Packagenet-snmp-utils/ensure:
created
notice:
/Stage1/Hdp::Snmp/Hdp::Packagesnmp/Hdp::Package::Process_pkgsnmp/Packagenet-snmp/ensure:
created
notice:
/Stage1/Hdp::Snmp/Hdp::Packagesnmp/Hdp::Package::Process_pkgsnmp/Hdp::Java::Packagesnmp/Execmkdir
-p /tmp/HDP-artifacts/ ; curl -f --retry 10
http://ip-10-101-1-112.ec2.internal:8080/resources//jdk-6u31-linux-x64.bin -o
/tmp/HDP-artifacts//jdk-6u31-linux-x64.bin snmp/returns: executed successfully
notice: /Stage1/Hdp::Set_selinux/Hdp::Exec/bin/echo 0 >
/selinux/enforce/Exec/bin/echo 0 > /selinux/enforce/returns: executed
successfully
notice:
/Stage1/Hdp::Snmp/Hdp::Packagesnmp/Hdp::Package::Process_pkgsnmp/Hdp::Java::Packagesnmp/Exec[mkdir
-p /usr/jdk ; chmod +x /tmp/HDP-artifacts//jdk-6u31-linux-x64.bin; cd /usr/jdk
; echo A | /tmp/HDP-artifacts//jdk-6u31-linux-x64.bin -noregister > /dev/null
2>&1 snmp]/returns: executed successfully
notice:
/Stage1/Hdp::Snmp/Hdp::Packagesnmp/Hdp::Package::Process_pkgsnmp/Hdp::Java::Packagesnmp/File/usr/jdk/jdk1.6.0_31/bin/java
snmp/ensure: created
notice:
/Stage1/Hdp::Snmp/Hdp::Snmp-configfilesnmpd.conf/Hdp::Configfile/etc/snmp//snmpd.conf/File/etc/snmp//snmpd.conf/content:
content changed '
{md5}8307434bc8ed4e2a7df4928fb4232778' to '{md5}
f786955c0c36f7f5a4f375e3fe93c959'
notice: /Stage1/Hdp::Snmp/Servicesnmpd/ensure: ensure changed 'stopped' to
'running'
notice: /Stage1/Hdp::Snmp/Servicesnmpd: Triggered 'refresh' from 1 events
notice:
/Stage1/Hdp::Snappy::Package/Hdp::Packagesnappy/Hdp::Package::Process_pkgsnappy/Packagesnappy-devel/ensure:
created
notice:
/Stage1/Hdp::Snappy::Package/Hdp::Snappy::Package::Ln64/Hdp::Exechdp::snappy::package::ln
64/Exechdp::snappy::package::ln 64/returns: executed successfully
notice:
/Stage1/Hdp::Snappy::Package/Hdp::Snappy::Package::Ln32/Hdp::Exechdp::snappy::package::ln
32/Exechdp::snappy::package::ln 32/returns: executed successfully
notice:
/Stage1/Hdp/Hdp::Packageglibc/Hdp::Package::Process_pkgglibc/Packageglibc.i686/ensure:
created
notice: /Stagemain/Hdp-hadoop/Hdp-hadoop::Packagehadoop/Hdp::Packagehadoop
64/Hdp::Package::Process_pkghadoop 64/Packagehadoop-sbin/ensure: created
notice: /Stagemain/Hdp-hadoop/Hdp-hadoop::Packagehadoop/Hdp::Packagehadoop
64/Hdp::Package::Process_pkghadoop 64/Packagehadoop-libhdfs/ensure: created
notice: /Stagemain/Hdp-hadoop/Hdp-hadoop::Packagehadoop/Hdp::Packagehadoop
64/Hdp::Package::Process_pkghadoop 64/Packagehadoop-pipes/ensure: created
notice: /Stagemain/Hdp-hadoop/Hdp-hadoop::Packagehadoop/Hdp::Packagehadoop
64/Hdp::Package::Process_pkghadoop 64/Packagehadoop-native/ensure: created
notice: /Stagemain/Hdp-hadoop/Hdp-hadoop::Packagehadoop/Hdp::Packagehadoop
64/Hdp::Package::Process_pkghadoop 64/Hdp::Java::Packagehadoop
64/File/usr/jdk/jdk1.6.0_31/bin/java hadoop 64/ensure: created
notice: /Stagemain/Hdp-hadoop/Hdp-hadoop::Packagehadoop/Hdp::Packagehadoop
64/Hdp::Package::Process_pkghadoop 64/Packagehadoop-lzo/ensure: created
notice:
/Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/var/run/hadoopXX/Hdp::Execmkdir
-p /var/run/hadoopXX/Execmkdir -p /var/run/hadoopXX/returns: executed
successfully
notice:
/Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/var/run/hadoopXX/Hdp::Directory/var/run/hadoopXX/File/var/run/hadoopXX/group:
group changed 'root' to 'hadoopxx'
notice:
/Stage2/Hdp-hadoop::Datanode/Hdp-hadoop::Datanode::Create_data_dirs/grid/0/hadoop/hdfs/data,/grid/1/hadoop/hdfs/data/Hdp::Directory_recursive_create_ignore_failure/grid/0/hadoop/hdfs/data/Hdp::Execmkdir
-p /grid/0/hadoop/hdfs/data ; exit 0/Execmkdir -p /grid/0/hadoop/hdfs/data ;
exit 0/returns: executed successfully
notice: /Stagemain/Hdp-hadoop/Hdp-hadoop::Packagehadoop/Hdp::Packagehadoop
64/Hdp::Package::Process_pkghadoop 64/Packagehadoop-lzo-native/ensure: created
notice:
/Stage2/Hdp-hadoop::Initialize/Hdp::Packageambari-log4j/Hdp::Package::Process_pkgambari-log4j/Hdp::Java::Packageambari-log4j/File/usr/jdk/jdk1.6.0_31/bin/java
ambari-log4j/ensure: created
notice:
/Stage2/Hdp-hadoop::Initialize/Hdp::Packageambari-log4j/Hdp::Package::Process_pkgambari-log4j/Packageambari-log4j/ensure:
created
notice:
/Stage2/Hdp-hadoop::Datanode/Hdp-hadoop::Datanode::Create_data_dirs/grid/0/hadoop/hdfs/data,/grid/1/hadoop/hdfs/data/Hdp::Directory_recursive_create_ignore_failure/grid/1/hadoop/hdfs/data/Hdp::Execmkdir
-p /grid/1/hadoop/hdfs/data ; exit 0/Execmkdir -p /grid/1/hadoop/hdfs/data ;
exit 0/returns: executed successfully
err: /Stagemain/Hdp-hadoop/Hdp::Usermapredxx/Usermapredxx/ensure: change from
absent to present failed: Could not create user mapredxx: Execution of
'/usr/sbin/useradd -s /bin/bash -g hadoopxx -G hadoopxx,mapredxx -m mapredxx'
returned 6: useradd: group 'mapredxx' does not exist
notice:
/Stage2/Hdp-hadoop::Initialize/File/usr/lib/hadoop/lib/hadoop-tools.jar/ensure:
created
notice:
/Stage2/Hdp-hadoop::Datanode/Hdp-hadoop::Datanode::Create_data_dirs/grid/0/hadoop/hdfs/data,/grid/1/hadoop/hdfs/data/Hdp::Directory_recursive_create_ignore_failure/grid/1/hadoop/hdfs/data/Hdp::Execchown
hdfsxx:hadoopxx /grid/1/hadoop/hdfs/data; exit 0/Execchown hdfsxx:hadoopxx
/grid/1/hadoop/hdfs/data; exit 0/returns: executed successfully
notice:
/Stage2/Hdp-hadoop::Datanode/Hdp-hadoop::Datanode::Create_data_dirs/grid/0/hadoop/hdfs/data,/grid/1/hadoop/hdfs/data/Hdp::Directory_recursive_create_ignore_failure/grid/1/hadoop/hdfs/data/Hdp::Execchmod
0750 /grid/1/hadoop/hdfs/data ; exit 0/Execchmod 0750 /grid/1/hadoop/hdfs/data
; exit 0/returns: executed successfully
notice:
/Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/var/log/hadoopXX/Hdp::Execmkdir
-p /var/log/hadoopXX/Execmkdir -p /var/log/hadoopXX/returns: executed
successfully
notice:
/Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/var/log/hadoopXX/Hdp::Directory/var/log/hadoopXX/File/var/log/hadoopXX/group:
group changed 'root' to 'hadoopxx'
notice:
/Stage2/Hdp-hadoop::Datanode/Hdp-hadoop::Datanode::Create_data_dirs/grid/0/hadoop/hdfs/data,/grid/1/hadoop/hdfs/data/Hdp::Directory_recursive_create_ignore_failure/grid/0/hadoop/hdfs/data/Hdp::Execchown
hdfsxx:hadoopxx /grid/0/hadoop/hdfs/data; exit 0/Execchown hdfsxx:hadoopxx
/grid/0/hadoop/hdfs/data; exit 0/returns: executed successfully
notice:
/Stage2/Hdp-hadoop::Datanode/Hdp-hadoop::Datanode::Create_data_dirs/grid/0/hadoop/hdfs/data,/grid/1/hadoop/hdfs/data/Hdp::Directory_recursive_create_ignore_failure/grid/0/hadoop/hdfs/data/Hdp::Execchmod
0750 /grid/0/hadoop/hdfs/data ; exit 0/Execchmod 0750 /grid/0/hadoop/hdfs/data
; exit 0/returns: executed successfully
err: /Stagemain/Hdp-hadoop/Hdp::Userhdfsxx/Userhdfsxx/ensure: change from
absent to present failed: Could not create user hdfsxx: Execution of
'/usr/sbin/useradd -s /bin/bash -g hadoopxx -G hadoopxx,hdfsxx -m hdfsxx'
returned 6: useradd: group 'hdfsxx' does not exist
notice:
/Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Execmkdir
-p /etc/hadoop/conf/Anchorhdp::exec::mkdir -p /etc/hadoop/conf::begin:
Dependency Usermapredxx has failures: true
notice:
/Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Execmkdir
-p /etc/hadoop/conf/Anchorhdp::exec::mkdir -p /etc/hadoop/conf::begin:
Dependency Userhdfsxx has failures: true
warning:
/Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Execmkdir
-p /etc/hadoop/conf/Anchorhdp::exec::mkdir -p /etc/hadoop/conf::begin:
Skipping because of failed dependencies
notice:
/Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Execmkdir
-p /etc/hadoop/conf/Execmkdir -p /etc/hadoop/conf: Dependency Usermapredxx has
failures: true
notice:
/Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Execmkdir
-p /etc/hadoop/conf/Execmkdir -p /etc/hadoop/conf: Dependency Userhdfsxx has
failures: true
warning:
/Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Execmkdir
-p /etc/hadoop/conf/Execmkdir -p /etc/hadoop/conf: Skipping because of failed
dependencies
notice:
/Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Execmkdir
-p /etc/hadoop/conf/Anchorhdp::exec::mkdir -p /etc/hadoop/conf::end:
Dependency Usermapredxx has failures: true
notice:
/Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Execmkdir
-p /etc/hadoop/conf/Anchorhdp::exec::mkdir -p /etc/hadoop/conf::end:
Dependency Userhdfsxx has failures: true
warning:
/Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Execmkdir
-p /etc/hadoop/conf/Anchorhdp::exec::mkdir -p /etc/hadoop/conf::end: Skipping
because of failed dependencies
notice:
/Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Directory/etc/hadoop/conf/File/etc/hadoop/conf:
Dependency Usermapredxx has failures: true
notice:
/Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Directory/etc/hadoop/conf/File/etc/hadoop/conf:
Dependency Userhdfsxx has failures: true
warning:
/Stagemain/Hdp-hadoop/Hdp::Directory_recursive_create/etc/hadoop/conf/Hdp::Directory/etc/hadoop/conf/File/etc/hadoop/conf:
Skipping because of failed dependencies
notice:
/Stage2/Hdp-hadoop::Initialize/File/etc/hadoop/conf/ssl-server.xml.example:
Dependency Usermapredxx has failures: true
notice:
/Stage2/Hdp-hadoop::Initialize/File/etc/hadoop/conf/ssl-server.xml.example:
Dependency Userhdfsxx has failures: true
warning:
/Stage2/Hdp-hadoop::Initialize/File/etc/hadoop/conf/ssl-server.xml.example:
Skipping because of failed dependencies
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
