----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/47355/#review133186 -----------------------------------------------------------
Ship it! Ship It! - Jayush Luniya On May 13, 2016, 7:53 p.m., Jonathan Hurley wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/47355/ > ----------------------------------------------------------- > > (Updated May 13, 2016, 7:53 p.m.) > > > Review request for Ambari, Jayush Luniya and Nate Cole. > > > Bugs: AMBARI-16664 > https://issues.apache.org/jira/browse/AMBARI-16664 > > > Repository: ambari > > > Description > ------- > > Caused by AMBARI-14430. > When installing clusters on redhat7 family OSs, depending on the topology the > installation could fail. > > ``` > Traceback (most recent call last): > File > "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/mapreduce2_client.py", > line 67, in <module> > MapReduce2Client().execute() > ... > raise Fail("Applying %s failed, parent directory %s doesn't exist" % > (self.resource, dirname)) > resource_management.core.exceptions.Fail: Applying > File['/usr/hdp/current/hadoop-yarn-client/bin/container-executor'] failed, > parent directory /usr/hdp/current/hadoop-yarn-client/bin doesn't exist > ``` > > This is because the specific package, in this case > hadoop_2_5_0_0_453-mapreduce is not installed because it's not sent down to > the agents as part of the packages structure. > This only affects some topologies since the affected components are installed > by other components which have the correct OS families specified in their > metainfo.xml files: > > ``` > [root@os-r7-fsqzxu-devdeployerie-3 data]# rpm -q --whatrequires > hadoop_2_5_0_0_453-mapreduce > hadoop_2_5_0_0_453-client-2.7.1.2.5.0.0-453.el6.x86_64 > tez_2_5_0_0_453-0.7.0.2.5.0.0-453.el6.noarch > tez_hive2_2_5_0_0_453-0.8.4.2.5.0.0-453.el6.noarch > ``` > > So, as long as Tez or Hadoop Client were installed on this box, then > MapReduce would be there too. > > Another example is ZooKeeper; since it's installed last, if any other > packages are installed before it, the bits will be there: > > ``` > [root@os-r7-fsqzxu-devdeployerie-3 data]# rpm -q --whatrequires > zookeeper_2_5_0_0_453 > hadoop_2_5_0_0_453-2.7.1.2.5.0.0-453.el6.x86_64 > storm_2_5_0_0_453-1.0.1.2.5.0.0-453.el6.x86_64 > hbase_2_5_0_0_453-1.1.2.2.5.0.0-453.el6.noarch > hive_2_5_0_0_453-1.2.1000.2.5.0.0-453.el6.noarch > hive2_2_5_0_0_453-2.1.0.2.5.0.0-453.el6.noarch > kafka_2_5_0_0_453-0.10.0.2.5.0.0-453.el6.noarch > ``` > > > Diffs > ----- > > > ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/metainfo.xml > 07080b4 > > ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/metainfo.xml > cb08a9c > > ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.6/metainfo.xml > 090e35d > ambari-server/src/main/resources/stacks/HDP/2.1/services/OOZIE/metainfo.xml > 7c4b232 > ambari-server/src/main/resources/stacks/HDP/2.2/services/HDFS/metainfo.xml > dacc1fb > ambari-server/src/main/resources/stacks/HDP/2.2/services/PIG/metainfo.xml > faf4c31 > ambari-server/src/main/resources/stacks/HDP/2.2/services/YARN/metainfo.xml > 629fe5f > > Diff: https://reviews.apache.org/r/47355/diff/ > > > Testing > ------- > > Deployed ZK and MapR to CentOS7 on isolated hosts. > > > Thanks, > > Jonathan Hurley > >