[ 
https://issues.apache.org/jira/browse/AMBARI-11306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14555592#comment-14555592
 ] 

Hudson commented on AMBARI-11306:
---------------------------------

FAILURE: Integrated in Ambari-trunk-Commit #2677 (See 
[https://builds.apache.org/job/Ambari-trunk-Commit/2677/])
AMBARI-11306. RU to copy correct version of tarball, including tez.tar.gz and 
mapreduce.tar.gz (alejandro) (afernandez: 
http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=f1787236115ea091a15e1e3a45deb4ec9be05f85)
* ambari-server/src/test/python/stacks/2.2/configs/journalnode-upgrade.json
* 
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server.py
* 
ambari-server/src/main/resources/stacks/HDP/2.3.GlusterFS/configuration/cluster-env.xml
* ambari-server/src/test/python/stacks/2.0.6/configs/default_hive_nn_ha.json
* ambari-server/src/test/python/stacks/2.0.6/PIG/test_pig_service_check.py
* 
ambari-server/src/test/python/stacks/2.2/configs/journalnode-upgrade-hdfs-secure.json
* ambari-server/src/test/python/stacks/2.3/configs/storm_default.json
* ambari-server/src/test/python/stacks/2.0.6/configs/hbase-rs-2.2.json
* ambari-server/src/test/python/stacks/2.2/configs/pig-service-check-secure.json
* 
ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.0_to_2.2.2.json
* ambari-server/src/main/resources/stacks/HDP/2.2/configuration/cluster-env.xml
* 
ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.0_to_2.2.4.json
* 
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py
* 
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive_service.py
* ambari-server/src/test/python/stacks/2.0.6/configs/zk-service_check_2.2.json
* 
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/job_history_server.py
* 
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py
* ambari-server/src/test/python/stacks/2.2/SPARK/test_job_history_server.py
* 
ambari-server/src/test/java/org/apache/ambari/server/upgrade/UpgradeCatalog200Test.java
* ambari-server/src/test/python/stacks/2.1/configs/client-upgrade.json
* 
ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.1_to_2.2.4.json
* ambari-server/src/test/python/stacks/2.0.6/configs/secured.json
* ambari-server/src/test/python/stacks/2.0.6/configs/hbase-check-2.2.json
* 
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/params_linux.py
* ambari-server/src/test/python/stacks/2.0.6/configs/nn_ru_lzo.json
* ambari-server/src/test/python/stacks/2.2/configs/oozie-downgrade.json
* 
ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_1.3_to_2.2.json
* 
ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/service_check.py
* 
ambari-common/src/main/python/resource_management/libraries/functions/check_process_status.py
* 
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/status_params.py
* ambari-server/src/test/python/stacks/2.2/configs/spark-job-history-server.json
* 
ambari-common/src/main/python/resource_management/libraries/functions/hive_check.py
* ambari-server/src/test/python/stacks/2.2/configs/ranger-usersync-upgrade.json
* ambari-server/src/test/python/stacks/2.2/configs/hive-upgrade.json
* ambari-server/src/test/python/stacks/2.2/SPARK/test_spark_service_check.py
* 
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py
* ambari-server/src/test/python/stacks/2.3/configs/hbase_secure.json
* ambari-server/src/test/python/stacks/2.0.6/configs/hbase-preupgrade.json
* 
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/params_linux.py
* ambari-server/src/test/python/stacks/2.0.6/configs/default.json
* ambari-server/src/test/python/stacks/2.2/configs/oozie-upgrade.json
* 
ambari-server/src/main/resources/upgrade/catalog/UpgradeCatalog_2.1_to_2.2.2.json
* 
ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params_linux.py
* ambari-server/src/test/python/stacks/2.2/configs/secured.json
* ambari-server/src/test/python/stacks/2.2/configs/default.json
* ambari-server/src/test/python/stacks/2.0.6/configs/default_no_install.json
* ambari-server/src/test/python/stacks/2.2/configs/falcon-upgrade.json
* 
ambari-server/src/test/resources/custom_actions/ru_execute_tasks_namenode_prepare.json
* ambari-server/src/test/python/stacks/2.0.6/configs/hbase-2.2.json
* ambari-server/src/test/python/stacks/2.3/configs/hbase_default.json
* ambari-server/src/test/python/stacks/2.0.6/configs/client-upgrade.json
* ambari-server/src/test/python/stacks/2.0.6/configs/ranger-namenode-start.json
* ambari-server/src/test/python/stacks/2.2/configs/ranger-admin-upgrade.json
* ambari-server/src/test/python/stacks/2.0.6/YARN/test_resourcemanager.py
* 
ambari-common/src/main/python/resource_management/libraries/resources/hdfs_resource.py
* 
ambari-common/src/main/python/resource_management/libraries/functions/copy_tarball.py
* ambari-server/src/test/python/stacks/2.2/PIG/test_pig_service_check.py
* 
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/historyserver.py
* 
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params_linux.py
* ambari-server/src/test/python/stacks/2.0.6/configs/default_hive_nn_ha_2.json
* 
ambari-server/src/main/resources/stacks/HDP/2.3.GlusterFS/configuration/cluster-env.xml.version
* 
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/service_check.py
* 
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/spark_service.py
* ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py
* ambari-server/src/test/python/stacks/2.0.6/YARN/test_historyserver.py


> RU to copy correct version of tarball, including tez.tar.gz and 
> mapreduce.tar.gz
> --------------------------------------------------------------------------------
>
>                 Key: AMBARI-11306
>                 URL: https://issues.apache.org/jira/browse/AMBARI-11306
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-server
>    Affects Versions: 2.0.0
>            Reporter: Alejandro Fernandez
>            Assignee: Alejandro Fernandez
>             Fix For: 2.1.0
>
>         Attachments: AMBARI-11306.patch
>
>
> We copy tarballs to HDFS in several places. The problem is that during 
> Resource Manager Start in RU it copies 
> /usr/hdp/current/tez-client/lib/tez.tar.gz to hdfs:///hdp/apps/{{ 
> hdp_stack_version }}/tez/
> for the hdp_stack_version value that comes from running "hdp-select status 
> hadoop-yarn-resourcemanager".
> So the destination is correct (uses the "to" version), but the source is 
> incorrect because the tez-client symlink is still pointing to the older 
> version, since tez-client only switches to the newer version when the Clients 
> are upgraded, which occurs later during the orchestration.
> The fix is that during RU, the source location of the tarballs must be 
> /usr/hdp/{{ hdp_version }}/component/tarball.tar.gz
> where {{ hdp_version }} is the version going to.
> Another problem is that during RU, HiveServer2 Start is not copying 
> mapreduce.tar.gz tarball to HDFS. In this Jira, we should also clean up the 
> tarball source and destination variables to come from a file instead of 
> configs in cluster-env.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to