-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/39955/
-----------------------------------------------------------

Review request for Ambari, Dmytro Grinenko, Dmitro Lisnichenko, Jayush Luniya, 
Nate Cole, and Swapan Shridhar.


Bugs: AMBARI-13723
    https://issues.apache.org/jira/browse/AMBARI-13723


Repository: ambari


Description
-------

We found a major flaw in the Express Upgrade from 2.1->2.3. Basically, "hadoop" 
bin still points to the old binary because we had to install HDP 2.3 while 2.1 
bits still existed.

**Manual Upgrade Instructions:**

* Stop all services using 2.1
* yum erase hadoop hdfs hive … (this will remove scripts /usr/bin/hadoop, 
/usr/bin/hdfs, /usr/bin/hive, etc/)
* yum install hadoop_2_3_* hdfs_2_3_* hive_2_3_* (rpm should point 
/usr/bin/hadoop -> /usr/hdp/current/hadoop-client/bin/hadoop)
* Change the version to 2.3 (hdp-select, conf-select, etc.)
* Start all services, and hence MR Service Check passes with "hadoop" command

**Express Upgrade:**

* Install HDP 2.3 bits. We reused the RU framework that relies on a 2 step 
process: install bits, perform upgrade. Hence, /usr/bin/hadoop is still using 
2.1 bits
* Stop all services using 2.1
* Change the version to 2.3 (hdp-select, conf-select, etc.)
* Start all services, will fail on MR Service Check because ExecuteHadoop() 
resource calls "hadoop" command, which is still pointing to 2.1 bits!

One solution is for the orchestration to remove the 2.1 bits before starting 
using 2.3.
Uninstalling the 2.1 bits will remove /usr/bin/hadoop, but when we call 
"hdp-select set hadoop-client <new_version>" it will create the symlink 
/usr/bin/hadoop -> /usr/hdp/current/hadoop-client/bin/hadoop


Diffs
-----

  ambari-server/src/main/resources/custom_actions/scripts/remove_bits.py 
PRE-CREATION 
  
ambari-server/src/main/resources/stacks/HDP/2.1/upgrades/nonrolling-upgrade-2.3.xml
 91d4f64 

Diff: https://reviews.apache.org/r/39955/diff/


Testing
-------

Verified during Express Upgrade from HDP 2.1->2.3


Thanks,

Alejandro Fernandez

Reply via email to