Honestly, I didn't investigate it that much after I discovered it was an issue with the HWX mirrors. What I can say is, the same version of Ambari installing the same version of HDP worked consistently before last week and broke consistently starting last week. Nothing on my end changed, so something in the mirrors changed. After switching mirrors to our internal mirrors which haven't been synced in a while, it worked again.
We don't provide a preconfigured database for Hive. We let Ambari automatically create one, so I think it *does* attempt to install MYSQL_SERVER automatically for us. IMO, there's another bug here besides the package update breaking things. yum install commands shouldn't fail if the package is already installed. Ambari should either a) check if something is installed before attempting to install it or b) ignore 'already installed' errors. Greg From: Alejandro Fernandez <afernan...@hortonworks.com<mailto:afernan...@hortonworks.com>> Date: Wednesday, November 25, 2015 at 12:29 PM To: "user@ambari.apache.org<mailto:user@ambari.apache.org>" <user@ambari.apache.org<mailto:user@ambari.apache.org>>, Greg <greg.h...@rackspace.com<mailto:greg.h...@rackspace.com>> Subject: Re: MYSQL_SERVER install failing 100% of the time now Actually, Hive MySQL should exclude mysql-community-release when not installing a new MySQL Server. Its params_linux.py contains, # There are other packages that contain /usr/share/java/mysql-connector-java.jar (like libmysql-java), # trying to install mysql-connector-java upon them can cause packages to conflict. if hive_use_existing_db: hive_exclude_packages = ['mysql-connector-java', 'mysql', 'mysql-server', 'mysql-community-release', 'mysql-community-server'] else: if 'role' in config and config['role'] != "MYSQL_SERVER": hive_exclude_packages = ['mysql', 'mysql-server', 'mysql-community-release', 'mysql-community-server'] if os.path.exists(mysql_jdbc_driver_jar): hive_exclude_packages.append('mysql-connector-java') In metainfo.xml, redhat7 installs mysql-community-release <osSpecific> <osFamily>redhat7</osFamily> <packages> <package> <name>mysql-community-release</name> <skipUpgrade>true</skipUpgrade> </package> <package> <name>mysql-community-server</name> <skipUpgrade>true</skipUpgrade> </package> </packages> </osSpecific> <osSpecific> Thanks, Alejandro From: Alejandro Fernandez <afernan...@hortonworks.com<mailto:afernan...@hortonworks.com>> Reply-To: "user@ambari.apache.org<mailto:user@ambari.apache.org>" <user@ambari.apache.org<mailto:user@ambari.apache.org>> Date: Wednesday, November 25, 2015 at 10:17 AM To: "user@ambari.apache.org<mailto:user@ambari.apache.org>" <user@ambari.apache.org<mailto:user@ambari.apache.org>>, "greg.h...@rackspace.com<mailto:greg.h...@rackspace.com>" <greg.h...@rackspace.com<mailto:greg.h...@rackspace.com>> Subject: Re: MYSQL_SERVER install failing 100% of the time now Hi Greg, what do you get after running, yum info mysql* It should contain the repo that provided it. Thanks, Alejandro From: Greg Hill <greg.h...@rackspace.com<mailto:greg.h...@rackspace.com>> Reply-To: "user@ambari.apache.org<mailto:user@ambari.apache.org>" <user@ambari.apache.org<mailto:user@ambari.apache.org>> Date: Wednesday, November 25, 2015 at 5:26 AM To: "user@ambari.apache.org<mailto:user@ambari.apache.org>" <user@ambari.apache.org<mailto:user@ambari.apache.org>> Subject: MYSQL_SERVER install failing 100% of the time now FYI, sometime in the last few days, MYSQL_SERVER install started failing 100% of the time with Ambari 2.1.0 and HDP 2.3.0.0 on CentOS 7. I'm guessing that a previously installed package now installs mysql-community-release as a dependency, whereas before it was only installed at this point. Was there a Hortonworks package update recently? Switching to internal mirrors that were synced a while back fixes the issues, so it's definitely something specific to Hortonworks public mirrors. Why this command fails if it's already installed is beyond me, but here's the error: resource_management.core.exceptions.Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install mysql-com munity-release' returned 1. Error: Nothing to do Traceback (most recent call last): File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/mysql_server.py ", line 64, in <module> MysqlServer().execute() File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 218, in execute method(env) File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/mysql_server.py ", line 33, in install self.install_packages(env, exclude_packages=params.hive_exclude_packages) File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 376, in install_packages Package(name) File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 154, in __init__ self.env.run() File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run self.run_action(resource, action) File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run _action provider_action() File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", l ine 45, in action_install self.install_package(package_name, self.resource.use_repos, self.resource.skip_repos) File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", lin e 49, in install_package shell.checked_call(cmd, sudo=True, logoutput=self.get_logoutput()) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner result = function(command, **kwargs) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_ca ll tries=tries, try_sleep=try_sleep) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wra pper result = _call(command, **kwargs_copy) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291, in _call raise Fail(err_msg) resource_management.core.exceptions.Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install mysql-com munity-release' returned 1. Error: Nothing to do
