----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/41432/#review110617 -----------------------------------------------------------
Ship it! Ship It! - Mahadev Konar On Dec. 16, 2015, 4:25 a.m., Alejandro Fernandez wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/41432/ > ----------------------------------------------------------- > > (Updated Dec. 16, 2015, 4:25 a.m.) > > > Review request for Ambari, Dmytro Grinenko, Dmitro Lisnichenko, Jonathan > Hurley, Jayush Luniya, and Nate Cole. > > > Bugs: AMBARI-14390 > https://issues.apache.org/jira/browse/AMBARI-14390 > > > Repository: ambari > > > Description > ------- > > *Steps:* > With Ambari 2.2.0, setup HDP 2.1 cluster (non HA, unsecure) with following > services: hbase,pig,slider,hive,oozie,sqoop,flume,falcon,storm > Did Express Upgrade from HDP 2.1 to 2.3.4 and let it finish > Observe the configs of various services > > *Result:* > Observed that the values of several properties showed up as blank and > required (mostly security related). Here is the list: > > HDFS: > > * hdfs_principal_name (hadoop-env, value is null, remove if not kerberized) > * hdfs_user_keytab (hadoop-env, value is null, remove if not kerberized) > * dfs.namenode.inode.attributes.provider.class (hdfs-site, value is null, set > to "org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer" if Ranger is > present, which it is not in HDP 2.1) > > YARN: > > * yarn.authorization-provider (yarn-site, value is null, set to > "org.apache.ranger.authorization.yarn.authorizer.RangerYarnAuthorizer" if > Ranger is present, which it is not in HDP 2.1) > > Tez: > > * tez.tez-ui.history-url.base (also tracked by AMBARI-14389, tez-site, value > is null, set to {code} > '{0}://{1}:{2}/#/main/views/TEZ/{3}/TEZ_CLUSTER_INSTANCE'.format(server_protocol, > server_host, server_port, latest_tez_jar_version) {code} by Stack Advisor) > > HBase: > > * hbase_principal_name (hbase-env, value is null, remove if not kerberized) > * hbase_user_keytab (hbase-env, value is null, remove if not kerberized) > > ZK: > > * zookeeper_keytab_path (zookeeper-env, value is null, remove if not > kerberized) > * zookeeper_principal_name (zookeeper-env, value is null, remove if not > kerberized) > > Storm: > > * nimbus_keytab (storm-env, value is null, remove if not kerberized) > * nimbus_principal_name (storm-env, value is null, remove if not kerberized) > * storm_keytab (storm-env, value is null, remove if not kerberized) > * storm_principal_name (storm-env, value is null, remove if not kerberized) > * storm_ui_keytab (storm-env, value is null, remove if not kerberized) > * storm_ui_principal_name (storm-env, value is null, remove if not kerberized) > * nimbus.authorizer (storm-site, need help from Storm team on what to set > this to since it depends on whether kerberos is enabled and Ranger is present) > > > Diffs > ----- > > > ambari-server/src/main/java/org/apache/ambari/server/controller/internal/UpgradeResourceProvider.java > 1e59b58 > > ambari-server/src/main/java/org/apache/ambari/server/state/ConfigMergeHelper.java > b799bc7 > > ambari-server/src/main/resources/stacks/HDP/2.1/upgrades/nonrolling-upgrade-2.3.xml > ef4b531 > ambari-server/src/main/resources/stacks/HDP/2.2/upgrades/config-upgrade.xml > ab384db > > Diff: https://reviews.apache.org/r/41432/diff/ > > > Testing > ------- > > Installed Ambari 2.2.0 with HDP 2.1 and all of the services listed above, > then performed Express Upgrade to HDP 2.3 and verified through the configs > page that no properties had null values. > This happened because of all of the kerberos-related properties in stack HDP > 2.3 have null, so the merging of configurations was adding the property. > > mvn clean test > > [INFO] > ------------------------------------------------------------------------ > [INFO] BUILD SUCCESS > [INFO] > ------------------------------------------------------------------------ > [INFO] Total time: 1:01:45.515s > [INFO] Finished at: Tue Dec 15 20:24:13 PST 2015 > [INFO] Final Memory: 120M/4042M > [INFO] > ------------------------------------------------------------------------ > > > Thanks, > > Alejandro Fernandez > >
