Srikanth Janardhan created AMBARI-23671: -------------------------------------------
Summary: HDP package not installed completely in one host while UI deploy in ubuntu16 Key: AMBARI-23671 URL: https://issues.apache.org/jira/browse/AMBARI-23671 Project: Ambari Issue Type: Bug Components: ambari-server Affects Versions: 2.7.0 Reporter: Srikanth Janardhan Fix For: 2.7.0 In cluster [http://ctr-e138-1518143905142-256808-01-000002.hwx.site:8080/], with ambari-2.7.0.0-374 and HDP-3.0.0.0-1236, HDP version is not installed in one of the hosts. When a reinstall from the hosts page was attempted, the following error occurred: {code:java} stderr: 2018-04-23 16:46:58,500 - Package Manager failed to install packages. Error: 'NoneType' object has no attribute 'replace' Traceback (most recent call last): File "/var/lib/ambari-agent/cache/custom_actions/scripts/install_packages.py", line 418, in install_packages retry_count=agent_stack_retry_count File "/usr/lib/ambari-agent/lib/ambari_commons/repo_manager/apt_manager.py", line 34, in wrapper name = args[1].replace("_", "-") AttributeError: 'NoneType' object has no attribute 'replace' Traceback (most recent call last): File "/var/lib/ambari-agent/cache/custom_actions/scripts/install_packages.py", line 480, in InstallPackages().execute() File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 353, in execute method(env) File "/var/lib/ambari-agent/cache/custom_actions/scripts/install_packages.py", line 149, in actionexecute raise Fail("Failed to distribute repositories/install packages") resource_management.core.exceptions.Fail: Failed to distribute repositories/install packages stdout: 2018-04-23 16:43:05,693 - Will install packages for repository version 3.0.0.0-1236 2018-04-23 16:43:05,694 - Repository['HDP-3.0-repo-1'] {'append_to_file': False, 'base_url': 'http://s3.amazonaws.com/dev.hortonworks.com/HDP/ubuntu16/3.x/BUILDS/3.0.0.0-1236', 'action': ['create'], 'components': [u'HDP', 'main'], 'repo_template': '{{package_type}} {{base_url}} {{components}}', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': None} 2018-04-23 16:43:05,704 - File['/tmp/tmpOEorH6'] {'content': 'deb http://s3.amazonaws.com/dev.hortonworks.com/HDP/ubuntu16/3.x/BUILDS/3.0.0.0-1236 HDP main'} 2018-04-23 16:43:05,706 - Writing File['/tmp/tmpOEorH6'] because contents don't match 2018-04-23 16:43:05,706 - File['/tmp/tmpcIEkzf'] {'content': StaticFile('/etc/apt/sources.list.d/ambari-hdp-1.list')} 2018-04-23 16:43:05,707 - Writing File['/tmp/tmpcIEkzf'] because contents don't match 2018-04-23 16:43:05,707 - File['/etc/apt/sources.list.d/ambari-hdp-1.list'] {'content': StaticFile('/tmp/tmpOEorH6')} 2018-04-23 16:43:05,708 - Writing File['/etc/apt/sources.list.d/ambari-hdp-1.list'] because contents don't match 2018-04-23 16:43:05,708 - checked_call[['apt-get', 'update', '-qq', '-o', u'Dir::Etc::sourcelist=sources.list.d/ambari-hdp-1.list', '-o', 'Dir::Etc::sourceparts=-', '-o', 'APT::Get::List-Cleanup=0']] {'sudo': True, 'quiet': False} 2018-04-23 16:43:06,136 - checked_call returned (0, '') 2018-04-23 16:43:06,138 - Repository['HDP-3.0-GPL-repo-1'] {'append_to_file': True, 'base_url': 'http://s3.amazonaws.com/dev.hortonworks.com/HDP-GPL/ubuntu16/3.x/BUILDS/3.0.0.0-1236', 'action': ['create'], 'components': [u'HDP-GPL', 'main'], 'repo_template': '{{package_type}} {{base_url}} {{components}}', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': None} 2018-04-23 16:43:06,141 - File['/tmp/tmpOz0KD_'] {'content': 'deb http://s3.amazonaws.com/dev.hortonworks.com/HDP/ubuntu16/3.x/BUILDS/3.0.0.0-1236 HDP main\ndeb http://s3.amazonaws.com/dev.hortonworks.com/HDP-GPL/ubuntu16/3.x/BUILDS/3.0.0.0-1236 HDP-GPL main'} 2018-04-23 16:43:06,141 - Writing File['/tmp/tmpOz0KD_'] because contents don't match 2018-04-23 16:43:06,142 - File['/tmp/tmpYf7ykB'] {'content': StaticFile('/etc/apt/sources.list.d/ambari-hdp-1.list')} 2018-04-23 16:43:06,142 - Writing File['/tmp/tmpYf7ykB'] because contents don't match 2018-04-23 16:43:06,143 - File['/etc/apt/sources.list.d/ambari-hdp-1.list'] {'content': StaticFile('/tmp/tmpOz0KD_')} 2018-04-23 16:43:06,143 - Writing File['/etc/apt/sources.list.d/ambari-hdp-1.list'] because contents don't match 2018-04-23 16:43:06,144 - checked_call[['apt-get', 'update', '-qq', '-o', u'Dir::Etc::sourcelist=sources.list.d/ambari-hdp-1.list', '-o', 'Dir::Etc::sourceparts=-', '-o', 'APT::Get::List-Cleanup=0']] {'sudo': True, 'quiet': False} 2018-04-23 16:43:06,834 - checked_call returned (0, '') 2018-04-23 16:43:06,835 - Repository['HDP-UTILS-1.1.0.22-repo-1'] {'append_to_file': True, 'base_url': 'http://s3.amazonaws.com/dev.hortonworks.com/HDP-UTILS-1.1.0.22/repos/ubuntu16', 'action': ['create'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '{{package_type}} {{base_url}} {{components}}', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': None} 2018-04-23 16:43:06,838 - File['/tmp/tmppCQdne'] {'content': 'deb http://s3.amazonaws.com/dev.hortonworks.com/HDP/ubuntu16/3.x/BUILDS/3.0.0.0-1236 HDP main\ndeb http://s3.amazonaws.com/dev.hortonworks.com/HDP-GPL/ubuntu16/3.x/BUILDS/3.0.0.0-1236 HDP-GPL main\ndeb http://s3.amazonaws.com/dev.hortonworks.com/HDP-UTILS-1.1.0.22/repos/ubuntu16 HDP-UTILS main'} 2018-04-23 16:43:06,839 - Writing File['/tmp/tmppCQdne'] because contents don't match 2018-04-23 16:43:06,839 - File['/tmp/tmpKfFXOr'] {'content': StaticFile('/etc/apt/sources.list.d/ambari-hdp-1.list')} 2018-04-23 16:43:06,839 - Writing File['/tmp/tmpKfFXOr'] because contents don't match 2018-04-23 16:43:06,840 - File['/etc/apt/sources.list.d/ambari-hdp-1.list'] {'content': StaticFile('/tmp/tmppCQdne')} 2018-04-23 16:43:06,840 - Writing File['/etc/apt/sources.list.d/ambari-hdp-1.list'] because contents don't match 2018-04-23 16:43:06,841 - checked_call[['apt-get', 'update', '-qq', '-o', u'Dir::Etc::sourcelist=sources.list.d/ambari-hdp-1.list', '-o', 'Dir::Etc::sourceparts=-', '-o', 'APT::Get::List-Cleanup=0']] {'sudo': True, 'quiet': False} 2018-04-23 16:43:07,679 - checked_call returned (0, '') 2018-04-23 16:43:07,680 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {} 2018-04-23 16:43:07,719 - call returned (0, '3.0.0.0-1236') 2018-04-23 16:43:07,720 - Temporary sources directory was created: /tmp/tmpnJ3jRc-ambari-apt-sources-d 2018-04-23 16:43:07,720 - Temporary sources file will be copied: /tmp/tmpnJ3jRc-ambari-apt-sources-d/ambari-hdp-1.list 2018-04-23 16:43:07,724 - Installing package hdp-select ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install -o Dir::Etc::SourceList=/dev/null -o Dir::Etc::SourceParts= hdp-select') 2018-04-23 16:43:07,794 - Removing temporary sources file: /tmp/tmpnJ3jRc-ambari-apt-sources-d/ambari-hdp-1.list 2018-04-23 16:43:07,795 - Removing temporary sources directory: /tmp/tmpnJ3jRc-ambari-apt-sources-d 2018-04-23 16:46:02,013 - Looking for matching packages in the following repositories: s3.amazonaws.com_dev.hortonworks.com_HDP_ubuntu16_3.x_BUILDS_3.0.0.0-1236, s3.amazonaws.com_dev.hortonworks.com_HDP-GPL_ubuntu16_3.x_BUILDS_3.0.0.0-1236, s3.amazonaws.com_dev.hortonworks.com_HDP-UTILS-1.1.0.22_repos_ubuntu16 2018-04-23 16:46:02,142 - Installing package sqoop-3-0-0-0-1236 ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install sqoop-3-0-0-0-1236') 2018-04-23 16:46:04,637 - Installing package druid-3-0-0-0-1236 ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install druid-3-0-0-0-1236') 2018-04-23 16:46:06,685 - Installing package hadoop-3-0-0-0-1236-client ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install hadoop-3-0-0-0-1236-client') 2018-04-23 16:46:08,813 - Installing package hadoop-3-0-0-0-1236-hdfs-datanode ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install hadoop-3-0-0-0-1236-hdfs-datanode') 2018-04-23 16:46:11,737 - Installing package hadoop-3-0-0-0-1236-hdfs-journalnode ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install hadoop-3-0-0-0-1236-hdfs-journalnode') 2018-04-23 16:46:14,169 - Installing package hadoop-3-0-0-0-1236-hdfs-namenode ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install hadoop-3-0-0-0-1236-hdfs-namenode') 2018-04-23 16:46:16,508 - Installing package hadoop-3-0-0-0-1236-hdfs-secondarynamenode ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install hadoop-3-0-0-0-1236-hdfs-secondarynamenode') 2018-04-23 16:46:18,552 - Installing package hadoop-3-0-0-0-1236-hdfs-zkfc ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install hadoop-3-0-0-0-1236-hdfs-zkfc') 2018-04-23 16:46:20,311 - Installing package libsnappy1v5 ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install libsnappy1v5') 2018-04-23 16:46:22,403 - Installing package libsnappy-dev ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install libsnappy-dev') 2018-04-23 16:46:24,257 - Installing package libhdfs0-3-0-0-0-1236 ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install libhdfs0-3-0-0-0-1236') 2018-04-23 16:46:25,874 - Installing package zip ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install zip') 2018-04-23 16:46:27,610 - Installing package oozie-3-0-0-0-1236 ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install oozie-3-0-0-0-1236') 2018-04-23 16:46:29,432 - Installing package tez-3-0-0-0-1236 ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install tez-3-0-0-0-1236') 2018-04-23 16:46:31,296 - Installing package accumulo-3-0-0-0-1236 ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install accumulo-3-0-0-0-1236') 2018-04-23 16:46:32,967 - Installing package hbase-3-0-0-0-1236 ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install hbase-3-0-0-0-1236') 2018-04-23 16:46:34,748 - Installing package phoenix-3-0-0-0-1236 ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install phoenix-3-0-0-0-1236') 2018-04-23 16:46:36,622 - Installing package zookeeper-3-0-0-0-1236 ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install zookeeper-3-0-0-0-1236') 2018-04-23 16:46:38,510 - Installing package zookeeper-3-0-0-0-1236-server ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install zookeeper-3-0-0-0-1236-server') 2018-04-23 16:46:40,400 - Installing package superset-3-0-0-0-1236 ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install superset-3-0-0-0-1236') 2018-04-23 16:46:41,957 - Installing package knox-3-0-0-0-1236 ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install knox-3-0-0-0-1236') 2018-04-23 16:46:43,753 - Installing package pig-3-0-0-0-1236 ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install pig-3-0-0-0-1236') 2018-04-23 16:46:45,614 - Installing package datafu-3-0-0-0-1236 ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install datafu-3-0-0-0-1236') 2018-04-23 16:46:47,223 - Installing package storm-3-0-0-0-1236 ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install storm-3-0-0-0-1236') 2018-04-23 16:46:48,975 - Installing package atlas-metadata-3-0-0-0-1236 ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install atlas-metadata-3-0-0-0-1236') 2018-04-23 16:46:50,920 - Installing package ambari-infra-solr-client ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install ambari-infra-solr-client') 2018-04-23 16:46:52,859 - Installing package kafka-3-0-0-0-1236 ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install kafka-3-0-0-0-1236') 2018-04-23 16:46:54,631 - Installing package gcc ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install gcc') 2018-04-23 16:46:56,550 - Installing package libsnappy1v5* ('/usr/bin/apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install 'libsnappy1v5*'') 2018-04-23 16:46:58,500 - No package found for zeppelin_${stack_version}(zeppelin_(\d|-)+$) 2018-04-23 16:46:58,500 - Package Manager failed to install packages. Error: 'NoneType' object has no attribute 'replace' Traceback (most recent call last): File "/var/lib/ambari-agent/cache/custom_actions/scripts/install_packages.py", line 418, in install_packages retry_count=agent_stack_retry_count File "/usr/lib/ambari-agent/lib/ambari_commons/repo_manager/apt_manager.py", line 34, in wrapper name = args[1].replace("_", "-") AttributeError: 'NoneType' object has no attribute 'replace' 2018-04-23 16:48:26,275 - Installation of packages failed. Checking if installation was partially complete 2018-04-23 16:48:26,276 - Old versions: ['3.0.0.0-1236'] 2018-04-23 16:48:26,276 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {} 2018-04-23 16:48:26,316 - call returned (0, '3.0.0.0-1236') 2018-04-23 16:48:26,316 - New versions: ['3.0.0.0-1236'] 2018-04-23 16:48:26,316 - Deltas: set([]) Command failed after 1 tries {code} Issue due to AMBARI-23570 -- This message was sent by Atlassian JIRA (v7.6.3#76005)