Re: Review Request 58780: WFM: Clicking search icon in workflow dashboard throws error

2017-04-27 Thread Anita Jebaraj


> On April 28, 2017, 5:24 a.m., Padma Priya N wrote:
> > Ship It!

Thank you for reviewing, can you please help in pushing the changes


- Anita


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58780/#review173292
---


On April 27, 2017, 4:41 p.m., Anita Jebaraj wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58780/
> ---
> 
> (Updated April 27, 2017, 4:41 p.m.)
> 
> 
> Review request for Ambari, belliraj hb, Di Li, DIPAYAN BHOWMICK, Padma Priya 
> N, and Sangeeta Ravindran.
> 
> 
> Bugs: AMBARI-20850
> https://issues.apache.org/jira/browse/AMBARI-20850
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Clicking on search icon when the filter is empty in workflow dashboard throws 
> the error Remote API failed as in screenshot
> 
> 
> Diffs
> -
> 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/components/search-create-new-bar.js
>  7e69dea 
> 
> 
> Diff: https://reviews.apache.org/r/58780/diff/2/
> 
> 
> Testing
> ---
> 
> Tested Manually
> 
> 
> File Attachments
> 
> 
> error
>   
> https://reviews.apache.org/media/uploaded/files/2017/04/27/6027e0bc-d946-4d10-80b1-440486278022__wf-error.jpg
> 
> 
> Thanks,
> 
> Anita Jebaraj
> 
>



Re: Review Request 58780: WFM: Clicking search icon in workflow dashboard throws error

2017-04-27 Thread belliraj hb

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58780/#review173293
---


Ship it!




Ship It!

- belliraj hb


On April 27, 2017, 4:41 p.m., Anita Jebaraj wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58780/
> ---
> 
> (Updated April 27, 2017, 4:41 p.m.)
> 
> 
> Review request for Ambari, belliraj hb, Di Li, DIPAYAN BHOWMICK, Padma Priya 
> N, and Sangeeta Ravindran.
> 
> 
> Bugs: AMBARI-20850
> https://issues.apache.org/jira/browse/AMBARI-20850
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Clicking on search icon when the filter is empty in workflow dashboard throws 
> the error Remote API failed as in screenshot
> 
> 
> Diffs
> -
> 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/components/search-create-new-bar.js
>  7e69dea 
> 
> 
> Diff: https://reviews.apache.org/r/58780/diff/2/
> 
> 
> Testing
> ---
> 
> Tested Manually
> 
> 
> File Attachments
> 
> 
> error
>   
> https://reviews.apache.org/media/uploaded/files/2017/04/27/6027e0bc-d946-4d10-80b1-440486278022__wf-error.jpg
> 
> 
> Thanks,
> 
> Anita Jebaraj
> 
>



Re: Review Request 58797: AMBARI-20868 : Ranger admin start fails when Ambari Infra is turned off.

2017-04-27 Thread Mugdha Varadkar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58797/#review173287
---


Ship it!




Ship It!

- Mugdha Varadkar


On April 27, 2017, 3:51 p.m., Vishal Suvagia wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58797/
> ---
> 
> (Updated April 27, 2017, 3:51 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Gautam Borad, Mugdha 
> Varadkar, Oliver Szabo, and Velmurugan Periasamy.
> 
> 
> Bugs: AMBARI-20868
> https://issues.apache.org/jira/browse/AMBARI-20868
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Ranger Admin start fails when Ambari Infra or External Solr service is down,. 
> need to handle errors and ensure Ranger start works, despite solr service 
> being down.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/common-services/RANGER/0.4.0/package/scripts/setup_ranger_xml.py
>  e56a705 
>   
> ambari-server/src/main/resources/common-services/RANGER/0.7.0/properties/ranger-solrconfig.xml.j2
>  34ce70d 
> 
> 
> Diff: https://reviews.apache.org/r/58797/diff/2/
> 
> 
> Testing
> ---
> 
> Verified fresh install on Cent-OS 6.
> 
> 
> Thanks,
> 
> Vishal Suvagia
> 
>



Re: Review Request 58798: AMBARI-20873 : Atlas gc-worker logs are not generated due to incorrect configuration

2017-04-27 Thread Mugdha Varadkar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58798/#review173286
---


Ship it!




Ship It!

- Mugdha Varadkar


On April 27, 2017, 2:39 p.m., Vishal Suvagia wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58798/
> ---
> 
> (Updated April 27, 2017, 2:39 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Gautam Borad, Madhan 
> Neethiraj, Mugdha Varadkar, and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-20873
> https://issues.apache.org/jira/browse/AMBARI-20873
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Atlas gc-worker logs are not generated due to missing / in atlas 
> configurations.
> Currently it is set as -Xloggc:$ATLAS_LOG_DIRgc-worker.log it should actually 
> be -Xloggc:$ATLAS_LOG_DIR/gc-worker.log
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/stacks/HDP/2.5/services/ATLAS/configuration/atlas-env.xml
>  bd0da9f 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml 
> 1c2ceff 
>   
> ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.5.xml
>  be8b750 
>   
> ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.6.xml
>  d822778 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.5.xml 
> 210c4e2 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.6.xml 
> 9a06dd0 
>   ambari-server/src/main/resources/stacks/HDP/2.6/upgrades/config-upgrade.xml 
> f5d87e9 
>   
> ambari-server/src/main/resources/stacks/HDP/2.6/upgrades/nonrolling-upgrade-2.6.xml
>  f7c276b 
>   ambari-server/src/main/resources/stacks/HDP/2.6/upgrades/upgrade-2.6.xml 
> 81757c1 
> 
> 
> Diff: https://reviews.apache.org/r/58798/diff/1/
> 
> 
> Testing
> ---
> 
> Verified fresh install and upgrade on Cent-OS 6.
> 
> 
> Thanks,
> 
> Vishal Suvagia
> 
>



Re: Review Request 58411: AMBARI-20726: Aggregate alert does not show status properly at Maintenance Mode change

2017-04-27 Thread Qin Liu


> On April 27, 2017, 6:48 p.m., Jonathan Hurley wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/events/listeners/alerts/AlertMaintenanceModeListener.java
> > Line 136 (original), 158-162 (patched)
> > 
> >
> > Let's get rid of this global boolean and just move it directly into the 
> > new method.

Fixed. Thanks Jonathan!


- Qin


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58411/#review173234
---


On April 28, 2017, 2:42 a.m., Qin Liu wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58411/
> ---
> 
> (Updated April 28, 2017, 2:42 a.m.)
> 
> 
> Review request for Ambari, Jonathan Hurley and Jayush Luniya.
> 
> 
> Bugs: AMBARI-20726
> https://issues.apache.org/jira/browse/AMBARI-20726
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Aggregate alert does not show status properly at Maintenance Mode change.
> 
> Steps to reproduce:
> Install a cluster that has HBase with one regionserver installed.
> 
> Scenario 1:
> 1. Turn On Maintenance Mode on the RegionServer or on the RegionServer host 
> or on the HBase service.
> 2. Stop the RegionServer after that.
> 3. No red alerts will show as expected.
>Percent RegionServers Available - OK affected: [0], total: [1]
> 4. Now Turn Off Maintenance Mode, still keep the RegionServer down.
>But Percent RegionServers Available alert will still show "OK" - "CRIT" is 
> expected.
> 
> Scenario 2:
> 1) Stop the RegionServer - Red alert will show as expected.
>Percent RegionServers Available - CRIT affected: [1], total: [1]
> 2) Now Turn On Maintenance Mode - For RegionServer status, Red alert will be 
> gone as expected.
>But Percent RegionServers Available alert will still show "CRIT" - "OK" is 
> expected.
>
> The fix is to fire an AggregateAlertRecalculateEvent to refresh aggregate 
> alert at Maintenance Mode change time.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/events/listeners/alerts/AlertMaintenanceModeListener.java
>  847a207 
>   ambari-server/src/main/java/org/apache/ambari/server/state/AlertState.java 
> 8e04eb1 
>   
> ambari-server/src/test/java/org/apache/ambari/server/events/listeners/upgrade/AlertMaintenanceModeListenerTest.java
>  bdc662a 
> 
> 
> Diff: https://reviews.apache.org/r/58411/diff/4/
> 
> 
> Testing
> ---
> 
> The fix has been manually tested via HDP UI.
> The unit testcase AlertMaintenanceModeListenerTest.java has been updated to 
> reflect the change.
> 
> testrun_ambari-server Results :
> Tests run: 4977, Failures: 0, Errors: 0, Skipped: 39
> 
> The skipped testcases has nothing to do with the fix.
> 
> 
> File Attachments
> 
> 
> AMBARI-20726.patch
>   
> https://reviews.apache.org/media/uploaded/files/2017/04/24/011309ea-84c8-470c-b467-bbe2a2372f46__AMBARI-20726.patch
> AMBARI-20726_2.patch
>   
> https://reviews.apache.org/media/uploaded/files/2017/04/26/8aa802d1-17a9-4871-8ea1-1449a29506ae__AMBARI-20726_2.patch
> 
> 
> Thanks,
> 
> Qin Liu
> 
>



Re: Review Request 58411: AMBARI-20726: Aggregate alert does not show status properly at Maintenance Mode change

2017-04-27 Thread Qin Liu

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58411/
---

(Updated April 28, 2017, 2:42 a.m.)


Review request for Ambari, Jonathan Hurley and Jayush Luniya.


Bugs: AMBARI-20726
https://issues.apache.org/jira/browse/AMBARI-20726


Repository: ambari


Description
---

Aggregate alert does not show status properly at Maintenance Mode change.

Steps to reproduce:
Install a cluster that has HBase with one regionserver installed.

Scenario 1:
1. Turn On Maintenance Mode on the RegionServer or on the RegionServer host or 
on the HBase service.
2. Stop the RegionServer after that.
3. No red alerts will show as expected.
   Percent RegionServers Available - OK affected: [0], total: [1]
4. Now Turn Off Maintenance Mode, still keep the RegionServer down.
   But Percent RegionServers Available alert will still show "OK" - "CRIT" is 
expected.

Scenario 2:
1) Stop the RegionServer - Red alert will show as expected.
   Percent RegionServers Available - CRIT affected: [1], total: [1]
2) Now Turn On Maintenance Mode - For RegionServer status, Red alert will be 
gone as expected.
   But Percent RegionServers Available alert will still show "CRIT" - "OK" is 
expected.
   
The fix is to fire an AggregateAlertRecalculateEvent to refresh aggregate alert 
at Maintenance Mode change time.


Diffs (updated)
-

  
ambari-server/src/main/java/org/apache/ambari/server/events/listeners/alerts/AlertMaintenanceModeListener.java
 847a207 
  ambari-server/src/main/java/org/apache/ambari/server/state/AlertState.java 
8e04eb1 
  
ambari-server/src/test/java/org/apache/ambari/server/events/listeners/upgrade/AlertMaintenanceModeListenerTest.java
 bdc662a 


Diff: https://reviews.apache.org/r/58411/diff/4/

Changes: https://reviews.apache.org/r/58411/diff/3-4/


Testing
---

The fix has been manually tested via HDP UI.
The unit testcase AlertMaintenanceModeListenerTest.java has been updated to 
reflect the change.

testrun_ambari-server Results :
Tests run: 4977, Failures: 0, Errors: 0, Skipped: 39

The skipped testcases has nothing to do with the fix.


File Attachments


AMBARI-20726.patch
  
https://reviews.apache.org/media/uploaded/files/2017/04/24/011309ea-84c8-470c-b467-bbe2a2372f46__AMBARI-20726.patch
AMBARI-20726_2.patch
  
https://reviews.apache.org/media/uploaded/files/2017/04/26/8aa802d1-17a9-4871-8ea1-1449a29506ae__AMBARI-20726_2.patch


Thanks,

Qin Liu



Re: Review Request 58823: Trunk patch - Storm Log4J Regex Replacement on Upgrade Fails

2017-04-27 Thread Madhuvanthi Radhakrishnan

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58823/
---

(Updated April 27, 2017, 11:14 p.m.)


Review request for Ambari, Alejandro Fernandez, Jonathan Hurley, Jayush Luniya, 
Sumit Mohanty, and Sriharsha Chintalapani.


Bugs: AMBARI-20880
https://issues.apache.org/jira/browse/AMBARI-20880


Repository: ambari


Description
---

Since there were changes made to trunk patch for storm worker log directory and 
not to branch-2.5. There are some extra fixes required in this patch. With 
this, both 2.5 and trunk will be on same page w.r.t upgrade packs for storm.


Diffs
-

  
ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigUpgradeChangeDefinition.java
 5c0fba7fc6 
  ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/config-upgrade.xml 
ffa8e61f25 
  
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.5.xml
 44367dcc47 
  
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.6.xml
 9362ae6b87 
  ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.5.xml 
698195502b 
  ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.6.xml 
0440dd3148 
  ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/config-upgrade.xml 
f99e764cc2 
  
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.5.xml
 3a428765fa 
  
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.6.xml
 b812547100 
  ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.5.xml 
50346274ea 
  ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.6.xml 
fbd61eae5a 
  ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml 
1c2ceff053 
  
ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.5.xml
 be8b750597 
  ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.5.xml 
210c4e2d39 


Diff: https://reviews.apache.org/r/58823/diff/1/


Testing (updated)
---

branch2.5 Ref: https://reviews.apache.org/r/58815/
Total run:1169
Total errors:0
Total failures:0
OK
[INFO]
[INFO] --- maven-checkstyle-plugin:2.17:check (checkstyle) @ ambari-server ---
[INFO] Starting audit...
Audit done.
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 25:47 min
[INFO] Finished at: 2017-04-27T15:42:48-07:00
[INFO] Final Memory: 71M/1001M
[INFO] 
:ambari-server mradhakrishnan$


Thanks,

Madhuvanthi Radhakrishnan



Review Request 58823: Trunk patch - Storm Log4J Regex Replacement on Upgrade Fails

2017-04-27 Thread Madhuvanthi Radhakrishnan

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58823/
---

Review request for Ambari, Alejandro Fernandez, Jonathan Hurley, Jayush Luniya, 
Sumit Mohanty, and Sriharsha Chintalapani.


Bugs: AMBARI-20880
https://issues.apache.org/jira/browse/AMBARI-20880


Repository: ambari


Description
---

Since there were changes made to trunk patch for storm worker log directory and 
not to branch-2.5. There are some extra fixes required in this patch. With 
this, both 2.5 and trunk will be on same page w.r.t upgrade packs for storm.


Diffs
-

  
ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigUpgradeChangeDefinition.java
 5c0fba7fc6 
  ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/config-upgrade.xml 
ffa8e61f25 
  
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.5.xml
 44367dcc47 
  
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.6.xml
 9362ae6b87 
  ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.5.xml 
698195502b 
  ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.6.xml 
0440dd3148 
  ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/config-upgrade.xml 
f99e764cc2 
  
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.5.xml
 3a428765fa 
  
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.6.xml
 b812547100 
  ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.5.xml 
50346274ea 
  ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.6.xml 
fbd61eae5a 
  ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml 
1c2ceff053 
  
ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.5.xml
 be8b750597 
  ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.5.xml 
210c4e2d39 


Diff: https://reviews.apache.org/r/58823/diff/1/


Testing
---

branch2.5 Ref: https://reviews.apache.org/r/58815/
Total run:1169
Total errors:0
Total failures:0
OK
[INFO]
[INFO] --- maven-checkstyle-plugin:2.17:check (checkstyle) @ ambari-server ---
[INFO] Starting audit...
Audit done.
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 25:47 min
[INFO] Finished at: 2017-04-27T15:42:48-07:00
[INFO] Final Memory: 71M/1001M
[INFO] 
HW12614:ambari-server mradhakrishnan$


Thanks,

Madhuvanthi Radhakrishnan



Re: Review Request 58802: Removing A Service Causes DB Verification To Produce Warnings

2017-04-27 Thread Alejandro Fernandez

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58802/#review173265
---




ambari-server/src/main/java/org/apache/ambari/server/checks/DatabaseConsistencyCheckHelper.java
Lines 563 (patched)


Use ==


- Alejandro Fernandez


On April 27, 2017, 4:16 p.m., Dmitro Lisnichenko wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58802/
> ---
> 
> (Updated April 27, 2017, 4:16 p.m.)
> 
> 
> Review request for Ambari, Jonathan Hurley and Nate Cole.
> 
> 
> Bugs: AMBARI-20875
> https://issues.apache.org/jira/browse/AMBARI-20875
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> When removing a service, the configurations for that service are kept for 
> historical purposes, but their various associations in the database are 
> removed (specifically, the {{serviceconfigmapping}} relationships).
> 
> After removing a service, the orphaned configurations now cause a warning to 
> be displayed on Ambari Server startup:
> 
> {noformat}
> 2017-04-06 17:15:24,003  WARN - You have config(s): 
> ranger-storm-policymgr-ssl-version1467149286586,atlas-env-version1471883877194,falcon-env-version1467044148480,storm-site-version1467149286586,storm-site-version1474944944095,ranger-storm-plugin-properties-version1467149286586,hana_hadoop-env-version1476989318735,hana_hadoop-env-version1468951412523,hanaes-site-version1475773173499,hanaes-site-version1477639131416,atlas-env-version1471880496396,falcon-startup.properties-version1474944962583,ranger-storm-security-version1467149286586,falcon-env-version1474944962517,application-properties-version1471883877194,hanaes-site-version1468951412523,application-properties-version1471992143777,application-properties-version1471880496396,hana_hadoop-env-version1475790068354,hana_hadoop-env-version1477639131416,falcon-runtime.properties-version1467044148480,atlas-env-version1471992143777,hana_hadoop-env-version1475773173499,storm-env-version1467149286586,hanaes-site-version1475790068354,hanaes
 
-site-version1476902714170,atlas-env-version1471883827584,hana_hadoop-env-version1477695406433,hanaes-site-version1476989583427,falcon-log4j-version1,falcon-env-version1474944962457,hanaes-site-version1468959251565,falcon-client.properties-version1,atlas-env-version1471993347065,falcon-startup.properties-version1467044148480,storm-cluster-log4j-version1467149286586,hanaes-site-version1472285532383,hana_hadoop-env-version1477695089738,hana_hadoop-env-version1468959251565,hana_hadoop-env-version1476989821279,atlas-log4j-version1,storm-site-version1467612840864,storm-worker-log4j-version1467149286586,ranger-storm-audit-version1467149286586,application-properties-version1471993347065,application-properties-version1471883827584,hana_hadoop-env-version1477695579450
 that is(are) not mapped (in serviceconfigmapping table) to any service!
> {noformat}
> 
> These orphaned configurations have entries in both {{clusterconfig}} and 
> {{clusterconfigmapping}} but are otherwise not references anywhere. They 
> don't hurt anything, but do trigger this warning since we can't determine if 
> they _should_ have mappings in {{serviceconfigmapping}}.
> 
> A few options:
> - When removing a service, remove configurations as well, leaving no orphans. 
> Some would argue that this is a bad move since re-adding the service later 
> would allow you to see the old configurations. I do not believe this is true 
> since the old configurations are never associated with the new service's 
> {{serviceconfig}} or {{serviceconfigmapping}}.
> 
> - Make the warning smarter somehow to ignore these since it's expected they 
> are orphaned.
> -- Somehow determine the service which should own the config and see if it 
> exists in the cluster?
> -- Add a new column to {{clusterconfig}} to mark it as deleted?
> 
> 
> To clean these warnings, we had to:
> {code}
> CREATE TEMPORARY TABLE IF NOT EXISTS orphaned_configs AS
> (SELECT
> cc.config_id,
> cc.type_name,
> cc.version_tag
> FROM clusterconfig cc, clusterconfigmapping ccm
> WHERE cc.config_id NOT IN (SELECT
> scm.config_id
> FROM serviceconfigmapping scm)
> AND cc.type_name != 'cluster-env'
> AND cc.type_name = ccm.type_name
> AND cc.version_tag = ccm.version_tag);
> 
> DELETE FROM clusterconfigmapping
> WHERE EXISTS
> (SELECT 1 FROM orphaned_configs
> WHERE clusterconfigmapping.type_name = orphaned_configs.type_name AND 
> clusterconfigmapping.version_tag = orphaned_configs.version_tag);
> 
> DELETE FROM clusterconfig WHERE clusterconfig.config_id IN (SELECT config_id 
> FROM orphaned_configs);
> 
> SELECT * FROM orphaned_configs;
> 
> DROP TABLE orphaned_configs;
> {code}
> 
> I've considered 

Re: Review Request 58802: Removing A Service Causes DB Verification To Produce Warnings

2017-04-27 Thread Alejandro Fernandez

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58802/#review173264
---


Ship it!




Ship It!

- Alejandro Fernandez


On April 27, 2017, 4:16 p.m., Dmitro Lisnichenko wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58802/
> ---
> 
> (Updated April 27, 2017, 4:16 p.m.)
> 
> 
> Review request for Ambari, Jonathan Hurley and Nate Cole.
> 
> 
> Bugs: AMBARI-20875
> https://issues.apache.org/jira/browse/AMBARI-20875
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> When removing a service, the configurations for that service are kept for 
> historical purposes, but their various associations in the database are 
> removed (specifically, the {{serviceconfigmapping}} relationships).
> 
> After removing a service, the orphaned configurations now cause a warning to 
> be displayed on Ambari Server startup:
> 
> {noformat}
> 2017-04-06 17:15:24,003  WARN - You have config(s): 
> ranger-storm-policymgr-ssl-version1467149286586,atlas-env-version1471883877194,falcon-env-version1467044148480,storm-site-version1467149286586,storm-site-version1474944944095,ranger-storm-plugin-properties-version1467149286586,hana_hadoop-env-version1476989318735,hana_hadoop-env-version1468951412523,hanaes-site-version1475773173499,hanaes-site-version1477639131416,atlas-env-version1471880496396,falcon-startup.properties-version1474944962583,ranger-storm-security-version1467149286586,falcon-env-version1474944962517,application-properties-version1471883877194,hanaes-site-version1468951412523,application-properties-version1471992143777,application-properties-version1471880496396,hana_hadoop-env-version1475790068354,hana_hadoop-env-version1477639131416,falcon-runtime.properties-version1467044148480,atlas-env-version1471992143777,hana_hadoop-env-version1475773173499,storm-env-version1467149286586,hanaes-site-version1475790068354,hanaes
 
-site-version1476902714170,atlas-env-version1471883827584,hana_hadoop-env-version1477695406433,hanaes-site-version1476989583427,falcon-log4j-version1,falcon-env-version1474944962457,hanaes-site-version1468959251565,falcon-client.properties-version1,atlas-env-version1471993347065,falcon-startup.properties-version1467044148480,storm-cluster-log4j-version1467149286586,hanaes-site-version1472285532383,hana_hadoop-env-version1477695089738,hana_hadoop-env-version1468959251565,hana_hadoop-env-version1476989821279,atlas-log4j-version1,storm-site-version1467612840864,storm-worker-log4j-version1467149286586,ranger-storm-audit-version1467149286586,application-properties-version1471993347065,application-properties-version1471883827584,hana_hadoop-env-version1477695579450
 that is(are) not mapped (in serviceconfigmapping table) to any service!
> {noformat}
> 
> These orphaned configurations have entries in both {{clusterconfig}} and 
> {{clusterconfigmapping}} but are otherwise not references anywhere. They 
> don't hurt anything, but do trigger this warning since we can't determine if 
> they _should_ have mappings in {{serviceconfigmapping}}.
> 
> A few options:
> - When removing a service, remove configurations as well, leaving no orphans. 
> Some would argue that this is a bad move since re-adding the service later 
> would allow you to see the old configurations. I do not believe this is true 
> since the old configurations are never associated with the new service's 
> {{serviceconfig}} or {{serviceconfigmapping}}.
> 
> - Make the warning smarter somehow to ignore these since it's expected they 
> are orphaned.
> -- Somehow determine the service which should own the config and see if it 
> exists in the cluster?
> -- Add a new column to {{clusterconfig}} to mark it as deleted?
> 
> 
> To clean these warnings, we had to:
> {code}
> CREATE TEMPORARY TABLE IF NOT EXISTS orphaned_configs AS
> (SELECT
> cc.config_id,
> cc.type_name,
> cc.version_tag
> FROM clusterconfig cc, clusterconfigmapping ccm
> WHERE cc.config_id NOT IN (SELECT
> scm.config_id
> FROM serviceconfigmapping scm)
> AND cc.type_name != 'cluster-env'
> AND cc.type_name = ccm.type_name
> AND cc.version_tag = ccm.version_tag);
> 
> DELETE FROM clusterconfigmapping
> WHERE EXISTS
> (SELECT 1 FROM orphaned_configs
> WHERE clusterconfigmapping.type_name = orphaned_configs.type_name AND 
> clusterconfigmapping.version_tag = orphaned_configs.version_tag);
> 
> DELETE FROM clusterconfig WHERE clusterconfig.config_id IN (SELECT config_id 
> FROM orphaned_configs);
> 
> SELECT * FROM orphaned_configs;
> 
> DROP TABLE orphaned_configs;
> {code}
> 
> I've considered advanced heuristics based on service metainfo with config 
> dependencies, and service config mappings. But this approach may be 
> unreliable when given 

Review Request 58822: Add Log Level Filter to the Log Search config API

2017-04-27 Thread Miklos Gergely

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58822/
---

Review request for Ambari, Oliver Szabo and Robert Nettleton.


Bugs: AMBARI-20881
https://issues.apache.org/jira/browse/AMBARI-20881


Repository: ambari


Description
---

Log Level Filters should be handled by the config API too

Also Log Level Filters should be per cluster, not only one for the Log Search 
Server. This means that some UI modifications are also necessary in order to 
query/persist changes of the log level filters for a specific cluster only.


Diffs
-

  ambari-logsearch/ambari-logsearch-config-api/pom.xml e9abed0 
  
ambari-logsearch/ambari-logsearch-config-api/src/main/java/org/apache/ambari/logsearch/config/api/InputConfigMonitor.java
 df26920 
  
ambari-logsearch/ambari-logsearch-config-api/src/main/java/org/apache/ambari/logsearch/config/api/LogLevelFilterMonitor.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-config-api/src/main/java/org/apache/ambari/logsearch/config/api/LogSearchConfig.java
 0bb0b78 
  
ambari-logsearch/ambari-logsearch-config-api/src/main/java/org/apache/ambari/logsearch/config/api/model/loglevelfilter/LogLevelFilter.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-config-api/src/main/java/org/apache/ambari/logsearch/config/api/model/loglevelfilter/LogLevelFilterMap.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-config-api/src/test/java/org/apache/ambari/logsearch/config/api/LogSearchConfigClass1.java
 969eb30 
  
ambari-logsearch/ambari-logsearch-config-api/src/test/java/org/apache/ambari/logsearch/config/api/LogSearchConfigClass2.java
 664ecc9 
  ambari-logsearch/ambari-logsearch-config-zookeeper/pom.xml 4ed8eba 
  
ambari-logsearch/ambari-logsearch-config-zookeeper/src/main/java/org/apache/ambari/logsearch/config/zookeeper/LogSearchConfigZK.java
 738fde2 
  
ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/LogFeeder.java
 074fedb 
  
ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/input/InputConfigUploader.java
 b70fbd1 
  
ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/logconfig/FilterLogData.java
 a05a916 
  
ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/logconfig/LogConfigFetcher.java
 12c744c 
  
ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/logconfig/LogConfigHandler.java
 0ece637 
  
ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/logconfig/LogFeederFilter.java
 60c8ae8 
  
ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/logconfig/LogFeederFilterWrapper.java
 9199cd3 
  
ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/loglevelfilter/FilterLogData.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/loglevelfilter/LogLevelFilterHandler.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/output/OutputManager.java
 135fb32 
  
ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/util/LogFeederUtil.java
 bb2f0a9 
  
ambari-logsearch/ambari-logsearch-logfeeder/src/test/java/org/apache/ambari/logfeeder/logconfig/LogConfigHandlerTest.java
 266108f 
  
ambari-logsearch/ambari-logsearch-logfeeder/src/test/resources/logfeeder.properties
 59020cc 
  
ambari-logsearch/ambari-logsearch-server/src/main/java/org/apache/ambari/logsearch/configurer/LogfeederFilterConfigurer.java
 c2d27f9 
  
ambari-logsearch/ambari-logsearch-server/src/main/java/org/apache/ambari/logsearch/dao/UserConfigSolrDao.java
 8fb27a7 
  
ambari-logsearch/ambari-logsearch-server/src/main/java/org/apache/ambari/logsearch/doc/DocConstants.java
 00adb67 
  
ambari-logsearch/ambari-logsearch-server/src/main/java/org/apache/ambari/logsearch/manager/ShipperConfigManager.java
 c0c1167 
  
ambari-logsearch/ambari-logsearch-server/src/main/java/org/apache/ambari/logsearch/manager/UserConfigManager.java
 a60fc5c 
  
ambari-logsearch/ambari-logsearch-server/src/main/java/org/apache/ambari/logsearch/model/common/LogFeederDataMap.java
 cc7d53d 
  
ambari-logsearch/ambari-logsearch-server/src/main/java/org/apache/ambari/logsearch/model/common/LogfeederFilterData.java
 e0f8013 
  
ambari-logsearch/ambari-logsearch-server/src/main/java/org/apache/ambari/logsearch/rest/ShipperConfigResource.java
 47e6ba2 
  
ambari-logsearch/ambari-logsearch-server/src/main/java/org/apache/ambari/logsearch/rest/UserConfigResource.java
 41dda05 
  
ambari-server/src/main/java/org/apache/ambari/server/upgrade/UpgradeCatalog300.java
 dbbbf20 
  

Re: Review Request 58814: Ambari clean up for 3.0

2017-04-27 Thread Alejandro Fernandez

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58814/#review173263
---


Ship it!




Ship It!

- Alejandro Fernandez


On April 27, 2017, 7:50 p.m., Vitalyi Brodetskyi wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58814/
> ---
> 
> (Updated April 27, 2017, 7:50 p.m.)
> 
> 
> Review request for Ambari, Robert Levas and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-20879
> https://issues.apache.org/jira/browse/AMBARI-20879
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> clean up.
> 
> 
> Diffs
> -
> 
>   ambari-agent/conf/unix/install-helper.sh 0e32d0a 
>   ambari-agent/pom.xml a57ed64 
>   ambari-agent/src/packages/tarball/all.xml 363941a 
>   ambari-server/conf/unix/install-helper.sh 8def27a 
>   ambari-server/src/main/assemblies/server.xml 2783526 
>   ambari-server/src/main/package/rpm/postinstall.sh 021a514 
>   ambari-server/src/main/python/ambari_server/serverConfiguration.py 7eba9db 
>   ambari-server/src/main/resources/scripts/check_ambari_permissions.py 
> bcb5fc0 
> 
> 
> Diff: https://reviews.apache.org/r/58814/diff/1/
> 
> 
> Testing
> ---
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Vitalyi Brodetskyi
> 
>



Re: Review Request 58815: Storm Log4J Regex Replacement on Upgrade Fails

2017-04-27 Thread Alejandro Fernandez

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58815/#review173262
---


Ship it!




Ship It!

- Alejandro Fernandez


On April 27, 2017, 8:36 p.m., Madhuvanthi Radhakrishnan wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58815/
> ---
> 
> (Updated April 27, 2017, 8:36 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Jonathan Hurley, Jayush 
> Luniya, Sumit Mohanty, and Sriharsha Chintalapani.
> 
> 
> Bugs: AMBARI-20880
> https://issues.apache.org/jira/browse/AMBARI-20880
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Find keys require an update due to inheritance from Storm 1.0.1 from HDP2.5 
> onwards
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigUpgradeChangeDefinition.java
>  5c0fba7fc6 
>   ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/config-upgrade.xml 
> 898b120c0c 
>   
> ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.5.xml
>  f42e0c8e49 
>   
> ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.6.xml
>  285aff8c97 
>   ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.5.xml 
> bc336bbf5e 
>   ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.6.xml 
> fa3b496be1 
>   ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/config-upgrade.xml 
> 9231c1222c 
>   
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.5.xml
>  ec5f1bbfb6 
>   
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.6.xml
>  819363a3dc 
>   ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.5.xml 
> 2d2e01c000 
>   ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.6.xml 
> 557976c165 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml 
> 44a9bd86a1 
> 
> 
> Diff: https://reviews.apache.org/r/58815/diff/1/
> 
> 
> Testing
> ---
> 
> Total run:1159
> Total errors:0
> Total failures:0
> OK
> [INFO]
> [INFO] --- maven-checkstyle-plugin:2.17:check (checkstyle) @ ambari-server ---
> [INFO] Starting audit...
> Audit done.
> [INFO] 
> 
> [INFO] BUILD SUCCESS
> [INFO] 
> 
> [INFO] Total time: 31:43 min
> [INFO] Finished at: 2017-04-27T12:52:07-07:00
> [INFO] Final Memory: 69M/999M
> [INFO] 
> 
> :ambari-server mradhakrishnan$ mvn clean test
> 
> 
> Thanks,
> 
> Madhuvanthi Radhakrishnan
> 
>



Re: Review Request 58815: Storm Log4J Regex Replacement on Upgrade Fails

2017-04-27 Thread Jonathan Hurley

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58815/#review173256
---


Ship it!




Ship It!

- Jonathan Hurley


On April 27, 2017, 4:36 p.m., Madhuvanthi Radhakrishnan wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58815/
> ---
> 
> (Updated April 27, 2017, 4:36 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Jonathan Hurley, Jayush 
> Luniya, Sumit Mohanty, and Sriharsha Chintalapani.
> 
> 
> Bugs: AMBARI-20880
> https://issues.apache.org/jira/browse/AMBARI-20880
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Find keys require an update due to inheritance from Storm 1.0.1 from HDP2.5 
> onwards
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigUpgradeChangeDefinition.java
>  5c0fba7fc6 
>   ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/config-upgrade.xml 
> 898b120c0c 
>   
> ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.5.xml
>  f42e0c8e49 
>   
> ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.6.xml
>  285aff8c97 
>   ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.5.xml 
> bc336bbf5e 
>   ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.6.xml 
> fa3b496be1 
>   ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/config-upgrade.xml 
> 9231c1222c 
>   
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.5.xml
>  ec5f1bbfb6 
>   
> ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.6.xml
>  819363a3dc 
>   ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.5.xml 
> 2d2e01c000 
>   ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.6.xml 
> 557976c165 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml 
> 44a9bd86a1 
> 
> 
> Diff: https://reviews.apache.org/r/58815/diff/1/
> 
> 
> Testing
> ---
> 
> Total run:1159
> Total errors:0
> Total failures:0
> OK
> [INFO]
> [INFO] --- maven-checkstyle-plugin:2.17:check (checkstyle) @ ambari-server ---
> [INFO] Starting audit...
> Audit done.
> [INFO] 
> 
> [INFO] BUILD SUCCESS
> [INFO] 
> 
> [INFO] Total time: 31:43 min
> [INFO] Finished at: 2017-04-27T12:52:07-07:00
> [INFO] Final Memory: 69M/999M
> [INFO] 
> 
> :ambari-server mradhakrishnan$ mvn clean test
> 
> 
> Thanks,
> 
> Madhuvanthi Radhakrishnan
> 
>



Review Request 58815: Storm Log4J Regex Replacement on Upgrade Fails

2017-04-27 Thread Madhuvanthi Radhakrishnan

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58815/
---

Review request for Ambari, Alejandro Fernandez, Jonathan Hurley, Jayush Luniya, 
Sumit Mohanty, and Sriharsha Chintalapani.


Bugs: AMBARI-20880
https://issues.apache.org/jira/browse/AMBARI-20880


Repository: ambari


Description
---

Find keys require an update due to inheritance from Storm 1.0.1 from HDP2.5 
onwards


Diffs
-

  
ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigUpgradeChangeDefinition.java
 5c0fba7fc6 
  ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/config-upgrade.xml 
898b120c0c 
  
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.5.xml
 f42e0c8e49 
  
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.6.xml
 285aff8c97 
  ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.5.xml 
bc336bbf5e 
  ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.6.xml 
fa3b496be1 
  ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/config-upgrade.xml 
9231c1222c 
  
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.5.xml
 ec5f1bbfb6 
  
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.6.xml
 819363a3dc 
  ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.5.xml 
2d2e01c000 
  ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.6.xml 
557976c165 
  ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml 
44a9bd86a1 


Diff: https://reviews.apache.org/r/58815/diff/1/


Testing
---

Total run:1159
Total errors:0
Total failures:0
OK
[INFO]
[INFO] --- maven-checkstyle-plugin:2.17:check (checkstyle) @ ambari-server ---
[INFO] Starting audit...
Audit done.
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 31:43 min
[INFO] Finished at: 2017-04-27T12:52:07-07:00
[INFO] Final Memory: 69M/999M
[INFO] 
:ambari-server mradhakrishnan$ mvn clean test


Thanks,

Madhuvanthi Radhakrishnan



Re: Review Request 58814: Ambari clean up for 3.0

2017-04-27 Thread Robert Levas

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58814/#review173250
---


Ship it!




Ship It!

- Robert Levas


On April 27, 2017, 3:50 p.m., Vitalyi Brodetskyi wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58814/
> ---
> 
> (Updated April 27, 2017, 3:50 p.m.)
> 
> 
> Review request for Ambari, Robert Levas and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-20879
> https://issues.apache.org/jira/browse/AMBARI-20879
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> clean up.
> 
> 
> Diffs
> -
> 
>   ambari-agent/conf/unix/install-helper.sh 0e32d0a 
>   ambari-agent/pom.xml a57ed64 
>   ambari-agent/src/packages/tarball/all.xml 363941a 
>   ambari-server/conf/unix/install-helper.sh 8def27a 
>   ambari-server/src/main/assemblies/server.xml 2783526 
>   ambari-server/src/main/package/rpm/postinstall.sh 021a514 
>   ambari-server/src/main/python/ambari_server/serverConfiguration.py 7eba9db 
>   ambari-server/src/main/resources/scripts/check_ambari_permissions.py 
> bcb5fc0 
> 
> 
> Diff: https://reviews.apache.org/r/58814/diff/1/
> 
> 
> Testing
> ---
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Vitalyi Brodetskyi
> 
>



Review Request 58814: Ambari clean up for 3.0

2017-04-27 Thread Vitalyi Brodetskyi

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58814/
---

Review request for Ambari, Robert Levas and Sumit Mohanty.


Bugs: AMBARI-20879
https://issues.apache.org/jira/browse/AMBARI-20879


Repository: ambari


Description
---

clean up.


Diffs
-

  ambari-agent/conf/unix/install-helper.sh 0e32d0a 
  ambari-agent/pom.xml a57ed64 
  ambari-agent/src/packages/tarball/all.xml 363941a 
  ambari-server/conf/unix/install-helper.sh 8def27a 
  ambari-server/src/main/assemblies/server.xml 2783526 
  ambari-server/src/main/package/rpm/postinstall.sh 021a514 
  ambari-server/src/main/python/ambari_server/serverConfiguration.py 7eba9db 
  ambari-server/src/main/resources/scripts/check_ambari_permissions.py bcb5fc0 


Diff: https://reviews.apache.org/r/58814/diff/1/


Testing
---

mvn clean test


Thanks,

Vitalyi Brodetskyi



Re: Review Request 58801: Unify repository file creation

2017-04-27 Thread Nate Cole

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58801/
---

(Updated April 27, 2017, 3:05 p.m.)


Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.


Changes
---

Updated test results.


Bugs: AMBARI-20871
https://issues.apache.org/jira/browse/AMBARI-20871


Repository: ambari


Description
---

We have 2 different ways of creating repositories - one is creating a new file 
for each repo definition (standard installation) and one file containing 
multiple repo definitions (install_packages).  These should both be done the 
same way (the install_packages way).


Diffs
-

  
ambari-common/src/main/python/resource_management/libraries/functions/repository_util.py
 PRE-CREATION 
  
ambari-server/src/main/java/org/apache/ambari/server/agent/CommandRepository.java
 PRE-CREATION 
  
ambari-server/src/main/java/org/apache/ambari/server/agent/ExecutionCommand.java
 8c726a0f2d 
  
ambari-server/src/main/java/org/apache/ambari/server/api/services/stackadvisor/commands/StackAdvisorCommand.java
 74a2cf2e32 
  
ambari-server/src/main/java/org/apache/ambari/server/bootstrap/DistributeRepositoriesStructuredOutput.java
 662b856c05 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/ActionExecutionContext.java
 3681eda976 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariActionExecutionHelper.java
 d556b603a8 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariCustomCommandExecutionHelper.java
 ab8b65968e 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariManagementControllerImpl.java
 751ce085d8 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/internal/ClusterStackVersionResourceProvider.java
 e39588ed42 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/internal/HostStackVersionResourceProvider.java
 811ce9b8cb 
  
ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/RepositoryVersionHelper.java
 fdb7c8d9b8 
  ambari-server/src/main/resources/custom_actions/scripts/install_packages.py 
33adce1414 
  
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/params.py
 6193c11c22 
  
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/repo_initialization.py
 a35dce757e 
  
ambari-server/src/test/java/org/apache/ambari/server/controller/internal/ClusterStackVersionResourceProviderTest.java
 8f7b31ddea 
  
ambari-server/src/test/java/org/apache/ambari/server/controller/internal/HostStackVersionResourceProviderTest.java
 4bed482f8d 
  
ambari-server/src/test/java/org/apache/ambari/server/serveraction/upgrades/UpgradeActionTest.java
 c6ee87588c 
  
ambari-server/src/test/java/org/apache/ambari/server/stack/UpdateActiveRepoVersionOnStartupTest.java
 df69f68f6c 
  
ambari-server/src/test/java/org/apache/ambari/server/state/stack/upgrade/RepositoryVersionHelperTest.java
 3a5532b08d 
  ambari-server/src/test/python/custom_actions/TestInstallPackages.py 
77e3bee3f6 
  
ambari-server/src/test/python/custom_actions/configs/install_packages_repository_file.json
 PRE-CREATION 
  ambari-server/src/test/python/stacks/2.0.6/configs/repository_file.json 
PRE-CREATION 
  
ambari-server/src/test/python/stacks/2.0.6/hooks/before-INSTALL/test_before_install.py
 082d2001cf 


Diff: https://reviews.apache.org/r/58801/diff/2/


Testing (updated)
---

Manual for both centos6 and ubuntu14.  Automated pending.

Tests run: 5009, Failures: 0, Errors: 0, Skipped: 39

[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 24:08 min
[INFO] Finished at: 2017-04-27T14:27:30-04:00
[INFO] Final Memory: 57M/635M
[INFO] 


Thanks,

Nate Cole



Re: Review Request 58801: Unify repository file creation

2017-04-27 Thread Nate Cole


> On April 27, 2017, 2:59 p.m., Jonathan Hurley wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/agent/CommandRepository.java
> > Lines 38-44 (patched)
> > 
> >
> > These are serialized to Python, right? As much as I love camelCase, do 
> > we need to use _ here?

Like 90% of the command json is camelCase, especially the top-level attributes. 
 Within them (say, roleParams) the map keys have underscores.  I wish we were 
consistent; in this case I took did what the majority of the file was formatted.


- Nate


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58801/#review173236
---


On April 27, 2017, 2:34 p.m., Nate Cole wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58801/
> ---
> 
> (Updated April 27, 2017, 2:34 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.
> 
> 
> Bugs: AMBARI-20871
> https://issues.apache.org/jira/browse/AMBARI-20871
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> We have 2 different ways of creating repositories - one is creating a new 
> file for each repo definition (standard installation) and one file containing 
> multiple repo definitions (install_packages).  These should both be done the 
> same way (the install_packages way).
> 
> 
> Diffs
> -
> 
>   
> ambari-common/src/main/python/resource_management/libraries/functions/repository_util.py
>  PRE-CREATION 
>   
> ambari-server/src/main/java/org/apache/ambari/server/agent/CommandRepository.java
>  PRE-CREATION 
>   
> ambari-server/src/main/java/org/apache/ambari/server/agent/ExecutionCommand.java
>  8c726a0f2d 
>   
> ambari-server/src/main/java/org/apache/ambari/server/api/services/stackadvisor/commands/StackAdvisorCommand.java
>  74a2cf2e32 
>   
> ambari-server/src/main/java/org/apache/ambari/server/bootstrap/DistributeRepositoriesStructuredOutput.java
>  662b856c05 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/ActionExecutionContext.java
>  3681eda976 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariActionExecutionHelper.java
>  d556b603a8 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariCustomCommandExecutionHelper.java
>  ab8b65968e 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariManagementControllerImpl.java
>  751ce085d8 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/internal/ClusterStackVersionResourceProvider.java
>  e39588ed42 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/internal/HostStackVersionResourceProvider.java
>  811ce9b8cb 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/RepositoryVersionHelper.java
>  fdb7c8d9b8 
>   ambari-server/src/main/resources/custom_actions/scripts/install_packages.py 
> 33adce1414 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/params.py
>  6193c11c22 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/repo_initialization.py
>  a35dce757e 
>   
> ambari-server/src/test/java/org/apache/ambari/server/controller/internal/ClusterStackVersionResourceProviderTest.java
>  8f7b31ddea 
>   
> ambari-server/src/test/java/org/apache/ambari/server/controller/internal/HostStackVersionResourceProviderTest.java
>  4bed482f8d 
>   
> ambari-server/src/test/java/org/apache/ambari/server/serveraction/upgrades/UpgradeActionTest.java
>  c6ee87588c 
>   
> ambari-server/src/test/java/org/apache/ambari/server/stack/UpdateActiveRepoVersionOnStartupTest.java
>  df69f68f6c 
>   
> ambari-server/src/test/java/org/apache/ambari/server/state/stack/upgrade/RepositoryVersionHelperTest.java
>  3a5532b08d 
>   ambari-server/src/test/python/custom_actions/TestInstallPackages.py 
> 77e3bee3f6 
>   
> ambari-server/src/test/python/custom_actions/configs/install_packages_repository_file.json
>  PRE-CREATION 
>   ambari-server/src/test/python/stacks/2.0.6/configs/repository_file.json 
> PRE-CREATION 
>   
> ambari-server/src/test/python/stacks/2.0.6/hooks/before-INSTALL/test_before_install.py
>  082d2001cf 
> 
> 
> Diff: https://reviews.apache.org/r/58801/diff/2/
> 
> 
> Testing
> ---
> 
> Manual for both centos6 and ubuntu14.  Automated pending.
> 
> 
> Thanks,
> 
> Nate Cole
> 
>



Re: Review Request 58801: Unify repository file creation

2017-04-27 Thread Jonathan Hurley

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58801/#review173236
---


Ship it!





ambari-server/src/main/java/org/apache/ambari/server/agent/CommandRepository.java
Lines 38-44 (patched)


These are serialized to Python, right? As much as I love camelCase, do we 
need to use _ here?


- Jonathan Hurley


On April 27, 2017, 2:34 p.m., Nate Cole wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58801/
> ---
> 
> (Updated April 27, 2017, 2:34 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.
> 
> 
> Bugs: AMBARI-20871
> https://issues.apache.org/jira/browse/AMBARI-20871
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> We have 2 different ways of creating repositories - one is creating a new 
> file for each repo definition (standard installation) and one file containing 
> multiple repo definitions (install_packages).  These should both be done the 
> same way (the install_packages way).
> 
> 
> Diffs
> -
> 
>   
> ambari-common/src/main/python/resource_management/libraries/functions/repository_util.py
>  PRE-CREATION 
>   
> ambari-server/src/main/java/org/apache/ambari/server/agent/CommandRepository.java
>  PRE-CREATION 
>   
> ambari-server/src/main/java/org/apache/ambari/server/agent/ExecutionCommand.java
>  8c726a0f2d 
>   
> ambari-server/src/main/java/org/apache/ambari/server/api/services/stackadvisor/commands/StackAdvisorCommand.java
>  74a2cf2e32 
>   
> ambari-server/src/main/java/org/apache/ambari/server/bootstrap/DistributeRepositoriesStructuredOutput.java
>  662b856c05 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/ActionExecutionContext.java
>  3681eda976 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariActionExecutionHelper.java
>  d556b603a8 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariCustomCommandExecutionHelper.java
>  ab8b65968e 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariManagementControllerImpl.java
>  751ce085d8 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/internal/ClusterStackVersionResourceProvider.java
>  e39588ed42 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/internal/HostStackVersionResourceProvider.java
>  811ce9b8cb 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/RepositoryVersionHelper.java
>  fdb7c8d9b8 
>   ambari-server/src/main/resources/custom_actions/scripts/install_packages.py 
> 33adce1414 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/params.py
>  6193c11c22 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/repo_initialization.py
>  a35dce757e 
>   
> ambari-server/src/test/java/org/apache/ambari/server/controller/internal/ClusterStackVersionResourceProviderTest.java
>  8f7b31ddea 
>   
> ambari-server/src/test/java/org/apache/ambari/server/controller/internal/HostStackVersionResourceProviderTest.java
>  4bed482f8d 
>   
> ambari-server/src/test/java/org/apache/ambari/server/serveraction/upgrades/UpgradeActionTest.java
>  c6ee87588c 
>   
> ambari-server/src/test/java/org/apache/ambari/server/stack/UpdateActiveRepoVersionOnStartupTest.java
>  df69f68f6c 
>   
> ambari-server/src/test/java/org/apache/ambari/server/state/stack/upgrade/RepositoryVersionHelperTest.java
>  3a5532b08d 
>   ambari-server/src/test/python/custom_actions/TestInstallPackages.py 
> 77e3bee3f6 
>   
> ambari-server/src/test/python/custom_actions/configs/install_packages_repository_file.json
>  PRE-CREATION 
>   ambari-server/src/test/python/stacks/2.0.6/configs/repository_file.json 
> PRE-CREATION 
>   
> ambari-server/src/test/python/stacks/2.0.6/hooks/before-INSTALL/test_before_install.py
>  082d2001cf 
> 
> 
> Diff: https://reviews.apache.org/r/58801/diff/2/
> 
> 
> Testing
> ---
> 
> Manual for both centos6 and ubuntu14.  Automated pending.
> 
> 
> Thanks,
> 
> Nate Cole
> 
>



Re: Review Request 58802: Removing A Service Causes DB Verification To Produce Warnings

2017-04-27 Thread Jonathan Hurley

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58802/#review173235
---




ambari-server/src/main/resources/Ambari-DDL-MySQL-CREATE.sql
Lines 98 (patched)


use a TINYINT isntead?


- Jonathan Hurley


On April 27, 2017, 12:16 p.m., Dmitro Lisnichenko wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58802/
> ---
> 
> (Updated April 27, 2017, 12:16 p.m.)
> 
> 
> Review request for Ambari, Jonathan Hurley and Nate Cole.
> 
> 
> Bugs: AMBARI-20875
> https://issues.apache.org/jira/browse/AMBARI-20875
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> When removing a service, the configurations for that service are kept for 
> historical purposes, but their various associations in the database are 
> removed (specifically, the {{serviceconfigmapping}} relationships).
> 
> After removing a service, the orphaned configurations now cause a warning to 
> be displayed on Ambari Server startup:
> 
> {noformat}
> 2017-04-06 17:15:24,003  WARN - You have config(s): 
> ranger-storm-policymgr-ssl-version1467149286586,atlas-env-version1471883877194,falcon-env-version1467044148480,storm-site-version1467149286586,storm-site-version1474944944095,ranger-storm-plugin-properties-version1467149286586,hana_hadoop-env-version1476989318735,hana_hadoop-env-version1468951412523,hanaes-site-version1475773173499,hanaes-site-version1477639131416,atlas-env-version1471880496396,falcon-startup.properties-version1474944962583,ranger-storm-security-version1467149286586,falcon-env-version1474944962517,application-properties-version1471883877194,hanaes-site-version1468951412523,application-properties-version1471992143777,application-properties-version1471880496396,hana_hadoop-env-version1475790068354,hana_hadoop-env-version1477639131416,falcon-runtime.properties-version1467044148480,atlas-env-version1471992143777,hana_hadoop-env-version1475773173499,storm-env-version1467149286586,hanaes-site-version1475790068354,hanaes
 
-site-version1476902714170,atlas-env-version1471883827584,hana_hadoop-env-version1477695406433,hanaes-site-version1476989583427,falcon-log4j-version1,falcon-env-version1474944962457,hanaes-site-version1468959251565,falcon-client.properties-version1,atlas-env-version1471993347065,falcon-startup.properties-version1467044148480,storm-cluster-log4j-version1467149286586,hanaes-site-version1472285532383,hana_hadoop-env-version1477695089738,hana_hadoop-env-version1468959251565,hana_hadoop-env-version1476989821279,atlas-log4j-version1,storm-site-version1467612840864,storm-worker-log4j-version1467149286586,ranger-storm-audit-version1467149286586,application-properties-version1471993347065,application-properties-version1471883827584,hana_hadoop-env-version1477695579450
 that is(are) not mapped (in serviceconfigmapping table) to any service!
> {noformat}
> 
> These orphaned configurations have entries in both {{clusterconfig}} and 
> {{clusterconfigmapping}} but are otherwise not references anywhere. They 
> don't hurt anything, but do trigger this warning since we can't determine if 
> they _should_ have mappings in {{serviceconfigmapping}}.
> 
> A few options:
> - When removing a service, remove configurations as well, leaving no orphans. 
> Some would argue that this is a bad move since re-adding the service later 
> would allow you to see the old configurations. I do not believe this is true 
> since the old configurations are never associated with the new service's 
> {{serviceconfig}} or {{serviceconfigmapping}}.
> 
> - Make the warning smarter somehow to ignore these since it's expected they 
> are orphaned.
> -- Somehow determine the service which should own the config and see if it 
> exists in the cluster?
> -- Add a new column to {{clusterconfig}} to mark it as deleted?
> 
> 
> To clean these warnings, we had to:
> {code}
> CREATE TEMPORARY TABLE IF NOT EXISTS orphaned_configs AS
> (SELECT
> cc.config_id,
> cc.type_name,
> cc.version_tag
> FROM clusterconfig cc, clusterconfigmapping ccm
> WHERE cc.config_id NOT IN (SELECT
> scm.config_id
> FROM serviceconfigmapping scm)
> AND cc.type_name != 'cluster-env'
> AND cc.type_name = ccm.type_name
> AND cc.version_tag = ccm.version_tag);
> 
> DELETE FROM clusterconfigmapping
> WHERE EXISTS
> (SELECT 1 FROM orphaned_configs
> WHERE clusterconfigmapping.type_name = orphaned_configs.type_name AND 
> clusterconfigmapping.version_tag = orphaned_configs.version_tag);
> 
> DELETE FROM clusterconfig WHERE clusterconfig.config_id IN (SELECT config_id 
> FROM orphaned_configs);
> 
> SELECT * FROM orphaned_configs;
> 
> DROP TABLE orphaned_configs;
> {code}
> 
> I've considered advanced heuristics 

Re: Review Request 58411: AMBARI-20726: Aggregate alert does not show status properly at Maintenance Mode change

2017-04-27 Thread Jonathan Hurley

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58411/#review173234
---




ambari-server/src/main/java/org/apache/ambari/server/events/listeners/alerts/AlertMaintenanceModeListener.java
Line 136 (original), 158-162 (patched)


Let's get rid of this global boolean and just move it directly into the new 
method.


- Jonathan Hurley


On April 27, 2017, noon, Qin Liu wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58411/
> ---
> 
> (Updated April 27, 2017, noon)
> 
> 
> Review request for Ambari, Jonathan Hurley and Jayush Luniya.
> 
> 
> Bugs: AMBARI-20726
> https://issues.apache.org/jira/browse/AMBARI-20726
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Aggregate alert does not show status properly at Maintenance Mode change.
> 
> Steps to reproduce:
> Install a cluster that has HBase with one regionserver installed.
> 
> Scenario 1:
> 1. Turn On Maintenance Mode on the RegionServer or on the RegionServer host 
> or on the HBase service.
> 2. Stop the RegionServer after that.
> 3. No red alerts will show as expected.
>Percent RegionServers Available - OK affected: [0], total: [1]
> 4. Now Turn Off Maintenance Mode, still keep the RegionServer down.
>But Percent RegionServers Available alert will still show "OK" - "CRIT" is 
> expected.
> 
> Scenario 2:
> 1) Stop the RegionServer - Red alert will show as expected.
>Percent RegionServers Available - CRIT affected: [1], total: [1]
> 2) Now Turn On Maintenance Mode - For RegionServer status, Red alert will be 
> gone as expected.
>But Percent RegionServers Available alert will still show "CRIT" - "OK" is 
> expected.
>
> The fix is to fire an AggregateAlertRecalculateEvent to refresh aggregate 
> alert at Maintenance Mode change time.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/events/listeners/alerts/AlertMaintenanceModeListener.java
>  847a207 
>   ambari-server/src/main/java/org/apache/ambari/server/state/AlertState.java 
> 8e04eb1 
>   
> ambari-server/src/test/java/org/apache/ambari/server/events/listeners/upgrade/AlertMaintenanceModeListenerTest.java
>  bdc662a 
> 
> 
> Diff: https://reviews.apache.org/r/58411/diff/3/
> 
> 
> Testing
> ---
> 
> The fix has been manually tested via HDP UI.
> The unit testcase AlertMaintenanceModeListenerTest.java has been updated to 
> reflect the change.
> 
> testrun_ambari-server Results :
> Tests run: 4977, Failures: 0, Errors: 0, Skipped: 39
> 
> The skipped testcases has nothing to do with the fix.
> 
> 
> File Attachments
> 
> 
> AMBARI-20726.patch
>   
> https://reviews.apache.org/media/uploaded/files/2017/04/24/011309ea-84c8-470c-b467-bbe2a2372f46__AMBARI-20726.patch
> AMBARI-20726_2.patch
>   
> https://reviews.apache.org/media/uploaded/files/2017/04/26/8aa802d1-17a9-4871-8ea1-1449a29506ae__AMBARI-20726_2.patch
> 
> 
> Thanks,
> 
> Qin Liu
> 
>



Re: Review Request 58801: Unify repository file creation

2017-04-27 Thread Nate Cole

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58801/
---

(Updated April 27, 2017, 2:34 p.m.)


Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.


Changes
---

Update for comments and test fixes.


Bugs: AMBARI-20871
https://issues.apache.org/jira/browse/AMBARI-20871


Repository: ambari


Description
---

We have 2 different ways of creating repositories - one is creating a new file 
for each repo definition (standard installation) and one file containing 
multiple repo definitions (install_packages).  These should both be done the 
same way (the install_packages way).


Diffs (updated)
-

  
ambari-common/src/main/python/resource_management/libraries/functions/repository_util.py
 PRE-CREATION 
  
ambari-server/src/main/java/org/apache/ambari/server/agent/CommandRepository.java
 PRE-CREATION 
  
ambari-server/src/main/java/org/apache/ambari/server/agent/ExecutionCommand.java
 8c726a0f2d 
  
ambari-server/src/main/java/org/apache/ambari/server/api/services/stackadvisor/commands/StackAdvisorCommand.java
 74a2cf2e32 
  
ambari-server/src/main/java/org/apache/ambari/server/bootstrap/DistributeRepositoriesStructuredOutput.java
 662b856c05 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/ActionExecutionContext.java
 3681eda976 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariActionExecutionHelper.java
 d556b603a8 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariCustomCommandExecutionHelper.java
 ab8b65968e 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariManagementControllerImpl.java
 751ce085d8 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/internal/ClusterStackVersionResourceProvider.java
 e39588ed42 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/internal/HostStackVersionResourceProvider.java
 811ce9b8cb 
  
ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/RepositoryVersionHelper.java
 fdb7c8d9b8 
  ambari-server/src/main/resources/custom_actions/scripts/install_packages.py 
33adce1414 
  
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/params.py
 6193c11c22 
  
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/repo_initialization.py
 a35dce757e 
  
ambari-server/src/test/java/org/apache/ambari/server/controller/internal/ClusterStackVersionResourceProviderTest.java
 8f7b31ddea 
  
ambari-server/src/test/java/org/apache/ambari/server/controller/internal/HostStackVersionResourceProviderTest.java
 4bed482f8d 
  
ambari-server/src/test/java/org/apache/ambari/server/serveraction/upgrades/UpgradeActionTest.java
 c6ee87588c 
  
ambari-server/src/test/java/org/apache/ambari/server/stack/UpdateActiveRepoVersionOnStartupTest.java
 df69f68f6c 
  
ambari-server/src/test/java/org/apache/ambari/server/state/stack/upgrade/RepositoryVersionHelperTest.java
 3a5532b08d 
  ambari-server/src/test/python/custom_actions/TestInstallPackages.py 
77e3bee3f6 
  
ambari-server/src/test/python/custom_actions/configs/install_packages_repository_file.json
 PRE-CREATION 
  ambari-server/src/test/python/stacks/2.0.6/configs/repository_file.json 
PRE-CREATION 
  
ambari-server/src/test/python/stacks/2.0.6/hooks/before-INSTALL/test_before_install.py
 082d2001cf 


Diff: https://reviews.apache.org/r/58801/diff/2/

Changes: https://reviews.apache.org/r/58801/diff/1-2/


Testing
---

Manual for both centos6 and ubuntu14.  Automated pending.


Thanks,

Nate Cole



Re: Review Request 58802: Removing A Service Causes DB Verification To Produce Warnings

2017-04-27 Thread Nate Cole

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58802/#review173221
---




ambari-server/src/main/java/org/apache/ambari/server/checks/DatabaseConsistencyCheckHelper.java
Lines 563 (patched)


Default in the entity is false (and non-null), so not sure you need 
Objects.equals() here.



ambari-server/src/main/resources/Ambari-DDL-Oracle-CREATE.sql
Lines 77-78 (original), 77-79 (patched)


we usually use some type of SMALLINT for booleans instead of VARCHAR(1)'s  
See host_role_command.is_background


- Nate Cole


On April 27, 2017, 12:16 p.m., Dmitro Lisnichenko wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58802/
> ---
> 
> (Updated April 27, 2017, 12:16 p.m.)
> 
> 
> Review request for Ambari, Jonathan Hurley and Nate Cole.
> 
> 
> Bugs: AMBARI-20875
> https://issues.apache.org/jira/browse/AMBARI-20875
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> When removing a service, the configurations for that service are kept for 
> historical purposes, but their various associations in the database are 
> removed (specifically, the {{serviceconfigmapping}} relationships).
> 
> After removing a service, the orphaned configurations now cause a warning to 
> be displayed on Ambari Server startup:
> 
> {noformat}
> 2017-04-06 17:15:24,003  WARN - You have config(s): 
> ranger-storm-policymgr-ssl-version1467149286586,atlas-env-version1471883877194,falcon-env-version1467044148480,storm-site-version1467149286586,storm-site-version1474944944095,ranger-storm-plugin-properties-version1467149286586,hana_hadoop-env-version1476989318735,hana_hadoop-env-version1468951412523,hanaes-site-version1475773173499,hanaes-site-version1477639131416,atlas-env-version1471880496396,falcon-startup.properties-version1474944962583,ranger-storm-security-version1467149286586,falcon-env-version1474944962517,application-properties-version1471883877194,hanaes-site-version1468951412523,application-properties-version1471992143777,application-properties-version1471880496396,hana_hadoop-env-version1475790068354,hana_hadoop-env-version1477639131416,falcon-runtime.properties-version1467044148480,atlas-env-version1471992143777,hana_hadoop-env-version1475773173499,storm-env-version1467149286586,hanaes-site-version1475790068354,hanaes
 
-site-version1476902714170,atlas-env-version1471883827584,hana_hadoop-env-version1477695406433,hanaes-site-version1476989583427,falcon-log4j-version1,falcon-env-version1474944962457,hanaes-site-version1468959251565,falcon-client.properties-version1,atlas-env-version1471993347065,falcon-startup.properties-version1467044148480,storm-cluster-log4j-version1467149286586,hanaes-site-version1472285532383,hana_hadoop-env-version1477695089738,hana_hadoop-env-version1468959251565,hana_hadoop-env-version1476989821279,atlas-log4j-version1,storm-site-version1467612840864,storm-worker-log4j-version1467149286586,ranger-storm-audit-version1467149286586,application-properties-version1471993347065,application-properties-version1471883827584,hana_hadoop-env-version1477695579450
 that is(are) not mapped (in serviceconfigmapping table) to any service!
> {noformat}
> 
> These orphaned configurations have entries in both {{clusterconfig}} and 
> {{clusterconfigmapping}} but are otherwise not references anywhere. They 
> don't hurt anything, but do trigger this warning since we can't determine if 
> they _should_ have mappings in {{serviceconfigmapping}}.
> 
> A few options:
> - When removing a service, remove configurations as well, leaving no orphans. 
> Some would argue that this is a bad move since re-adding the service later 
> would allow you to see the old configurations. I do not believe this is true 
> since the old configurations are never associated with the new service's 
> {{serviceconfig}} or {{serviceconfigmapping}}.
> 
> - Make the warning smarter somehow to ignore these since it's expected they 
> are orphaned.
> -- Somehow determine the service which should own the config and see if it 
> exists in the cluster?
> -- Add a new column to {{clusterconfig}} to mark it as deleted?
> 
> 
> To clean these warnings, we had to:
> {code}
> CREATE TEMPORARY TABLE IF NOT EXISTS orphaned_configs AS
> (SELECT
> cc.config_id,
> cc.type_name,
> cc.version_tag
> FROM clusterconfig cc, clusterconfigmapping ccm
> WHERE cc.config_id NOT IN (SELECT
> scm.config_id
> FROM serviceconfigmapping scm)
> AND cc.type_name != 'cluster-env'
> AND cc.type_name = ccm.type_name
> AND cc.version_tag = ccm.version_tag);
> 
> DELETE FROM clusterconfigmapping
> WHERE EXISTS
> (SELECT 1 FROM orphaned_configs
> 

Re: Review Request 58800: Changes to events format

2017-04-27 Thread Sid Wagle

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58800/#review173220
---


Ship it!




Ship It!

- Sid Wagle


On April 27, 2017, 2:54 p.m., Andrew Onischuk wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58800/
> ---
> 
> (Updated April 27, 2017, 2:54 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Myroslav Papirkovskyy, and 
> Sid Wagle.
> 
> 
> Bugs: AMBARI-20869
> https://issues.apache.org/jira/browse/AMBARI-20869
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Changes we discussed with Myroslav Papyrkovskyy to format data in more 
> suitable
> for server way.
> 
>   * use cluster id instead of name
>   * remove some dictionary keys in events to make handing them simpler
>   * don't use component name as key in topology dictionary to be ready for 
> multiInstances work.
> 
> 
> Diffs
> -
> 
>   ambari-agent/src/main/python/ambari_agent/ClusterCache.py d5e724c 
>   ambari-agent/src/main/python/ambari_agent/ClusterConfigurationCache.py 
> 03e9645 
>   ambari-agent/src/main/python/ambari_agent/ComponentStatusExecutor.py 
> 70cd82a 
>   ambari-agent/src/main/python/ambari_agent/Constants.py 5ea916c 
>   ambari-agent/src/main/python/ambari_agent/HeartbeatThread.py 6b68f27 
>   ambari-agent/src/main/python/ambari_agent/Utils.py 456b2b3 
>   ambari-agent/src/test/python/ambari_agent/TestAgentStompResponses.py 
> 7ea0646 
>   
> ambari-agent/src/test/python/ambari_agent/dummy_files/stomp/components_status_report.json
>  c1ce406 
>   
> ambari-agent/src/test/python/ambari_agent/dummy_files/stomp/configurations_update.json
>  41cef61 
>   
> ambari-agent/src/test/python/ambari_agent/dummy_files/stomp/execution_commands.json
>  1eeeb7c 
>   
> ambari-agent/src/test/python/ambari_agent/dummy_files/stomp/metadata_after_registration.json
>  8ccd8e8 
>   
> ambari-agent/src/test/python/ambari_agent/dummy_files/stomp/metadata_update.json
>  96b929b 
>   
> ambari-agent/src/test/python/ambari_agent/dummy_files/stomp/registration_request.json
>  64077b3 
>   
> ambari-agent/src/test/python/ambari_agent/dummy_files/stomp/registration_response.json
>  f744410 
>   
> ambari-agent/src/test/python/ambari_agent/dummy_files/stomp/topology_update.json
>  291249c 
> 
> 
> Diff: https://reviews.apache.org/r/58800/diff/1/
> 
> 
> Testing
> ---
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Andrew Onischuk
> 
>



Re: Review Request 58780: WFM: Clicking search icon in workflow dashboard throws error

2017-04-27 Thread Anita Jebaraj

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58780/
---

(Updated April 27, 2017, 4:41 p.m.)


Review request for Ambari, belliraj hb, Di Li, DIPAYAN BHOWMICK, Padma Priya N, 
and Sangeeta Ravindran.


Bugs: AMBARI-20850
https://issues.apache.org/jira/browse/AMBARI-20850


Repository: ambari


Description
---

Clicking on search icon when the filter is empty in workflow dashboard throws 
the error Remote API failed as in screenshot


Diffs (updated)
-

  
contrib/views/wfmanager/src/main/resources/ui/app/components/search-create-new-bar.js
 7e69dea 


Diff: https://reviews.apache.org/r/58780/diff/2/

Changes: https://reviews.apache.org/r/58780/diff/1-2/


Testing
---

Tested Manually


File Attachments


error
  
https://reviews.apache.org/media/uploaded/files/2017/04/27/6027e0bc-d946-4d10-80b1-440486278022__wf-error.jpg


Thanks,

Anita Jebaraj



Re: Review Request 58780: WFM: Clicking search icon in workflow dashboard throws error

2017-04-27 Thread Anita Jebaraj


> On April 27, 2017, 6:15 a.m., Padma Priya N wrote:
> > contrib/views/wfmanager/src/main/resources/ui/app/components/search-create-new-bar.js
> > Lines 193 (patched)
> > 
> >
> > It is better to use Ember.isBlank() instead of !=

I have updated in the new patch


- Anita


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58780/#review173160
---


On April 27, 2017, 5:59 a.m., Anita Jebaraj wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58780/
> ---
> 
> (Updated April 27, 2017, 5:59 a.m.)
> 
> 
> Review request for Ambari, belliraj hb, Di Li, DIPAYAN BHOWMICK, Padma Priya 
> N, and Sangeeta Ravindran.
> 
> 
> Bugs: AMBARI-20850
> https://issues.apache.org/jira/browse/AMBARI-20850
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Clicking on search icon when the filter is empty in workflow dashboard throws 
> the error Remote API failed as in screenshot
> 
> 
> Diffs
> -
> 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/components/search-create-new-bar.js
>  7e69dea 
> 
> 
> Diff: https://reviews.apache.org/r/58780/diff/1/
> 
> 
> Testing
> ---
> 
> Tested Manually
> 
> 
> File Attachments
> 
> 
> error
>   
> https://reviews.apache.org/media/uploaded/files/2017/04/27/6027e0bc-d946-4d10-80b1-440486278022__wf-error.jpg
> 
> 
> Thanks,
> 
> Anita Jebaraj
> 
>



Review Request 58802: Removing A Service Causes DB Verification To Produce Warnings

2017-04-27 Thread Dmitro Lisnichenko

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58802/
---

Review request for Ambari, Jonathan Hurley and Nate Cole.


Bugs: AMBARI-20875
https://issues.apache.org/jira/browse/AMBARI-20875


Repository: ambari


Description
---

When removing a service, the configurations for that service are kept for 
historical purposes, but their various associations in the database are removed 
(specifically, the {{serviceconfigmapping}} relationships).

After removing a service, the orphaned configurations now cause a warning to be 
displayed on Ambari Server startup:

{noformat}
2017-04-06 17:15:24,003  WARN - You have config(s): 
ranger-storm-policymgr-ssl-version1467149286586,atlas-env-version1471883877194,falcon-env-version1467044148480,storm-site-version1467149286586,storm-site-version1474944944095,ranger-storm-plugin-properties-version1467149286586,hana_hadoop-env-version1476989318735,hana_hadoop-env-version1468951412523,hanaes-site-version1475773173499,hanaes-site-version1477639131416,atlas-env-version1471880496396,falcon-startup.properties-version1474944962583,ranger-storm-security-version1467149286586,falcon-env-version1474944962517,application-properties-version1471883877194,hanaes-site-version1468951412523,application-properties-version1471992143777,application-properties-version1471880496396,hana_hadoop-env-version1475790068354,hana_hadoop-env-version1477639131416,falcon-runtime.properties-version1467044148480,atlas-env-version1471992143777,hana_hadoop-env-version1475773173499,storm-env-version1467149286586,hanaes-site-version1475790068354,hanaes-s
 
ite-version1476902714170,atlas-env-version1471883827584,hana_hadoop-env-version1477695406433,hanaes-site-version1476989583427,falcon-log4j-version1,falcon-env-version1474944962457,hanaes-site-version1468959251565,falcon-client.properties-version1,atlas-env-version1471993347065,falcon-startup.properties-version1467044148480,storm-cluster-log4j-version1467149286586,hanaes-site-version1472285532383,hana_hadoop-env-version1477695089738,hana_hadoop-env-version1468959251565,hana_hadoop-env-version1476989821279,atlas-log4j-version1,storm-site-version1467612840864,storm-worker-log4j-version1467149286586,ranger-storm-audit-version1467149286586,application-properties-version1471993347065,application-properties-version1471883827584,hana_hadoop-env-version1477695579450
 that is(are) not mapped (in serviceconfigmapping table) to any service!
{noformat}

These orphaned configurations have entries in both {{clusterconfig}} and 
{{clusterconfigmapping}} but are otherwise not references anywhere. They don't 
hurt anything, but do trigger this warning since we can't determine if they 
_should_ have mappings in {{serviceconfigmapping}}.

A few options:
- When removing a service, remove configurations as well, leaving no orphans. 
Some would argue that this is a bad move since re-adding the service later 
would allow you to see the old configurations. I do not believe this is true 
since the old configurations are never associated with the new service's 
{{serviceconfig}} or {{serviceconfigmapping}}.

- Make the warning smarter somehow to ignore these since it's expected they are 
orphaned.
-- Somehow determine the service which should own the config and see if it 
exists in the cluster?
-- Add a new column to {{clusterconfig}} to mark it as deleted?


To clean these warnings, we had to:
{code}
CREATE TEMPORARY TABLE IF NOT EXISTS orphaned_configs AS
(SELECT
cc.config_id,
cc.type_name,
cc.version_tag
FROM clusterconfig cc, clusterconfigmapping ccm
WHERE cc.config_id NOT IN (SELECT
scm.config_id
FROM serviceconfigmapping scm)
AND cc.type_name != 'cluster-env'
AND cc.type_name = ccm.type_name
AND cc.version_tag = ccm.version_tag);

DELETE FROM clusterconfigmapping
WHERE EXISTS
(SELECT 1 FROM orphaned_configs
WHERE clusterconfigmapping.type_name = orphaned_configs.type_name AND 
clusterconfigmapping.version_tag = orphaned_configs.version_tag);

DELETE FROM clusterconfig WHERE clusterconfig.config_id IN (SELECT config_id 
FROM orphaned_configs);

SELECT * FROM orphaned_configs;

DROP TABLE orphaned_configs;
{code}

I've considered advanced heuristics based on service metainfo with config 
dependencies, and service config mappings. But this approach may be unreliable 
when given inaccurate service metainfo between stack upgrades. Also, this 
approach is likely to delay server start on clusters with thousands of configs.
So the solution Add a new column to clusterconfig to mark it as deleted. So 
warning will not be generated for such cluster configs.


Diffs
-

  
ambari-server/src/main/java/org/apache/ambari/server/checks/DatabaseConsistencyCheckHelper.java
 c33c4e3815 
  ambari-server/src/main/java/org/apache/ambari/server/orm/dao/ClusterDAO.java 
b21aeff946 
  

Re: Review Request 58801: Unify repository file creation

2017-04-27 Thread Dmitro Lisnichenko

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58801/#review173211
---


Fix it, then Ship it!





ambari-common/src/main/python/resource_management/libraries/functions/repository_util.py
Lines 86 (patched)


is that intended?


- Dmitro Lisnichenko


On April 27, 2017, 6:09 p.m., Nate Cole wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58801/
> ---
> 
> (Updated April 27, 2017, 6:09 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.
> 
> 
> Bugs: AMBARI-20871
> https://issues.apache.org/jira/browse/AMBARI-20871
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> We have 2 different ways of creating repositories - one is creating a new 
> file for each repo definition (standard installation) and one file containing 
> multiple repo definitions (install_packages).  These should both be done the 
> same way (the install_packages way).
> 
> 
> Diffs
> -
> 
>   
> ambari-common/src/main/python/resource_management/libraries/functions/repository_util.py
>  PRE-CREATION 
>   
> ambari-server/src/main/java/org/apache/ambari/server/agent/CommandRepository.java
>  PRE-CREATION 
>   
> ambari-server/src/main/java/org/apache/ambari/server/agent/ExecutionCommand.java
>  8c726a0f2d 
>   
> ambari-server/src/main/java/org/apache/ambari/server/api/services/stackadvisor/commands/StackAdvisorCommand.java
>  74a2cf2e32 
>   
> ambari-server/src/main/java/org/apache/ambari/server/bootstrap/DistributeRepositoriesStructuredOutput.java
>  662b856c05 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/ActionExecutionContext.java
>  3681eda976 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariActionExecutionHelper.java
>  d556b603a8 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariCustomCommandExecutionHelper.java
>  ab8b65968e 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariManagementControllerImpl.java
>  751ce085d8 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/internal/ClusterStackVersionResourceProvider.java
>  e39588ed42 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/internal/HostStackVersionResourceProvider.java
>  811ce9b8cb 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/RepositoryVersionHelper.java
>  fdb7c8d9b8 
>   ambari-server/src/main/resources/custom_actions/scripts/install_packages.py 
> 33adce1414 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/params.py
>  6193c11c22 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/repo_initialization.py
>  a35dce757e 
>   
> ambari-server/src/test/java/org/apache/ambari/server/controller/internal/ClusterStackVersionResourceProviderTest.java
>  8f7b31ddea 
>   
> ambari-server/src/test/java/org/apache/ambari/server/controller/internal/HostStackVersionResourceProviderTest.java
>  4bed482f8d 
>   
> ambari-server/src/test/java/org/apache/ambari/server/serveraction/upgrades/UpgradeActionTest.java
>  c6ee87588c 
>   ambari-server/src/test/python/custom_actions/TestInstallPackages.py 
> 77e3bee3f6 
>   
> ambari-server/src/test/python/custom_actions/configs/install_packages_repository_file.json
>  PRE-CREATION 
>   ambari-server/src/test/python/stacks/2.0.6/configs/repository_file.json 
> PRE-CREATION 
>   
> ambari-server/src/test/python/stacks/2.0.6/hooks/before-INSTALL/test_before_install.py
>  082d2001cf 
> 
> 
> Diff: https://reviews.apache.org/r/58801/diff/1/
> 
> 
> Testing
> ---
> 
> Manual for both centos6 and ubuntu14.  Automated pending.
> 
> 
> Thanks,
> 
> Nate Cole
> 
>



Re: Review Request 58411: AMBARI-20726: Aggregate alert does not show status properly at Maintenance Mode change

2017-04-27 Thread Qin Liu


> On April 26, 2017, 11:38 p.m., Jonathan Hurley wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/events/listeners/alerts/AlertMaintenanceModeListener.java
> > Line 107 (original), 124-126 (patched)
> > 
> >
> > Instead of wrapping each of these in an if-statement, just invoke this 
> > method once inside of `recalculateAggregateAlert`

Fixed it. Thanks Jonathan!


> On April 26, 2017, 11:38 p.m., Jonathan Hurley wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/events/listeners/alerts/AlertMaintenanceModeListener.java
> > Lines 174-177 (patched)
> > 
> >
> > This is going to fire `n` events based on the number of current alerts 
> > which have aggregates. Since this is only needed once (it's a general 
> > recalculation), then you only need to call it once as long as there is at 
> > least 1 alert which matches the criteria.

Fixed it. Thanks Jonathan!


- Qin


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58411/#review173129
---


On April 27, 2017, 4 p.m., Qin Liu wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58411/
> ---
> 
> (Updated April 27, 2017, 4 p.m.)
> 
> 
> Review request for Ambari, Jonathan Hurley and Jayush Luniya.
> 
> 
> Bugs: AMBARI-20726
> https://issues.apache.org/jira/browse/AMBARI-20726
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Aggregate alert does not show status properly at Maintenance Mode change.
> 
> Steps to reproduce:
> Install a cluster that has HBase with one regionserver installed.
> 
> Scenario 1:
> 1. Turn On Maintenance Mode on the RegionServer or on the RegionServer host 
> or on the HBase service.
> 2. Stop the RegionServer after that.
> 3. No red alerts will show as expected.
>Percent RegionServers Available - OK affected: [0], total: [1]
> 4. Now Turn Off Maintenance Mode, still keep the RegionServer down.
>But Percent RegionServers Available alert will still show "OK" - "CRIT" is 
> expected.
> 
> Scenario 2:
> 1) Stop the RegionServer - Red alert will show as expected.
>Percent RegionServers Available - CRIT affected: [1], total: [1]
> 2) Now Turn On Maintenance Mode - For RegionServer status, Red alert will be 
> gone as expected.
>But Percent RegionServers Available alert will still show "CRIT" - "OK" is 
> expected.
>
> The fix is to fire an AggregateAlertRecalculateEvent to refresh aggregate 
> alert at Maintenance Mode change time.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/events/listeners/alerts/AlertMaintenanceModeListener.java
>  847a207 
>   ambari-server/src/main/java/org/apache/ambari/server/state/AlertState.java 
> 8e04eb1 
>   
> ambari-server/src/test/java/org/apache/ambari/server/events/listeners/upgrade/AlertMaintenanceModeListenerTest.java
>  bdc662a 
> 
> 
> Diff: https://reviews.apache.org/r/58411/diff/3/
> 
> 
> Testing
> ---
> 
> The fix has been manually tested via HDP UI.
> The unit testcase AlertMaintenanceModeListenerTest.java has been updated to 
> reflect the change.
> 
> testrun_ambari-server Results :
> Tests run: 4977, Failures: 0, Errors: 0, Skipped: 39
> 
> The skipped testcases has nothing to do with the fix.
> 
> 
> File Attachments
> 
> 
> AMBARI-20726.patch
>   
> https://reviews.apache.org/media/uploaded/files/2017/04/24/011309ea-84c8-470c-b467-bbe2a2372f46__AMBARI-20726.patch
> AMBARI-20726_2.patch
>   
> https://reviews.apache.org/media/uploaded/files/2017/04/26/8aa802d1-17a9-4871-8ea1-1449a29506ae__AMBARI-20726_2.patch
> 
> 
> Thanks,
> 
> Qin Liu
> 
>



Re: Review Request 58411: AMBARI-20726: Aggregate alert does not show status properly at Maintenance Mode change

2017-04-27 Thread Qin Liu


> On April 26, 2017, 5:59 p.m., Alejandro Fernandez wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/events/listeners/alerts/AlertMaintenanceModeListener.java
> > Lines 170 (patched)
> > 
> >
> > Why isn't the OK state part of this?
> > 
> > 
> > If only these 2 states are valid, let's use a collection of states that 
> > force a recalculation and put it in AlertState.java
> 
> Qin Liu wrote:
> Hi Alejandro,
> 
> The OK state of the alert is not part of this because the state of its 
> aggregate alert won't be affected by MM state changes, The alert in 
> CRITICAL/WARNING state will affect its aggregate alert because its state will 
> be changed from muffed CRITICAL/WARNING state to CRITICAL/WARNING state when 
> MM is changed from MM on to MM off or CRITICAL/WARNING state to muffed 
> CRITICAL/WARNING state.when MM is changed from MM off to MM on.
> 
> For your 2nd comment, could you please explain how to use a collection of 
> states that force a recalculation and put it in AlertState.java? Thank you!
> 
> Alejandro Fernandez wrote:
> public static EnumSet RECALCULATE_AGG_STATUS_STATES = 
> EnumSet.of(CRITIAL, WARNING);
> 
> And just use a .contains()

Fixed. Thanks Akejandro!


- Qin


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58411/#review173069
---


On April 27, 2017, 4 p.m., Qin Liu wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58411/
> ---
> 
> (Updated April 27, 2017, 4 p.m.)
> 
> 
> Review request for Ambari, Jonathan Hurley and Jayush Luniya.
> 
> 
> Bugs: AMBARI-20726
> https://issues.apache.org/jira/browse/AMBARI-20726
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Aggregate alert does not show status properly at Maintenance Mode change.
> 
> Steps to reproduce:
> Install a cluster that has HBase with one regionserver installed.
> 
> Scenario 1:
> 1. Turn On Maintenance Mode on the RegionServer or on the RegionServer host 
> or on the HBase service.
> 2. Stop the RegionServer after that.
> 3. No red alerts will show as expected.
>Percent RegionServers Available - OK affected: [0], total: [1]
> 4. Now Turn Off Maintenance Mode, still keep the RegionServer down.
>But Percent RegionServers Available alert will still show "OK" - "CRIT" is 
> expected.
> 
> Scenario 2:
> 1) Stop the RegionServer - Red alert will show as expected.
>Percent RegionServers Available - CRIT affected: [1], total: [1]
> 2) Now Turn On Maintenance Mode - For RegionServer status, Red alert will be 
> gone as expected.
>But Percent RegionServers Available alert will still show "CRIT" - "OK" is 
> expected.
>
> The fix is to fire an AggregateAlertRecalculateEvent to refresh aggregate 
> alert at Maintenance Mode change time.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/events/listeners/alerts/AlertMaintenanceModeListener.java
>  847a207 
>   ambari-server/src/main/java/org/apache/ambari/server/state/AlertState.java 
> 8e04eb1 
>   
> ambari-server/src/test/java/org/apache/ambari/server/events/listeners/upgrade/AlertMaintenanceModeListenerTest.java
>  bdc662a 
> 
> 
> Diff: https://reviews.apache.org/r/58411/diff/3/
> 
> 
> Testing
> ---
> 
> The fix has been manually tested via HDP UI.
> The unit testcase AlertMaintenanceModeListenerTest.java has been updated to 
> reflect the change.
> 
> testrun_ambari-server Results :
> Tests run: 4977, Failures: 0, Errors: 0, Skipped: 39
> 
> The skipped testcases has nothing to do with the fix.
> 
> 
> File Attachments
> 
> 
> AMBARI-20726.patch
>   
> https://reviews.apache.org/media/uploaded/files/2017/04/24/011309ea-84c8-470c-b467-bbe2a2372f46__AMBARI-20726.patch
> AMBARI-20726_2.patch
>   
> https://reviews.apache.org/media/uploaded/files/2017/04/26/8aa802d1-17a9-4871-8ea1-1449a29506ae__AMBARI-20726_2.patch
> 
> 
> Thanks,
> 
> Qin Liu
> 
>



Re: Review Request 58797: AMBARI-20868 : Ranger admin start fails when Ambari Infra is turned off.

2017-04-27 Thread Vishal Suvagia via Review Board

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58797/
---

(Updated April 27, 2017, 3:51 p.m.)


Review request for Ambari, Alejandro Fernandez, Gautam Borad, Mugdha Varadkar, 
Oliver Szabo, and Velmurugan Periasamy.


Changes
---

Updated patch to address review comments


Bugs: AMBARI-20868
https://issues.apache.org/jira/browse/AMBARI-20868


Repository: ambari


Description
---

Ranger Admin start fails when Ambari Infra or External Solr service is down,. 
need to handle errors and ensure Ranger start works, despite solr service being 
down.


Diffs (updated)
-

  
ambari-server/src/main/resources/common-services/RANGER/0.4.0/package/scripts/setup_ranger_xml.py
 e56a705 
  
ambari-server/src/main/resources/common-services/RANGER/0.7.0/properties/ranger-solrconfig.xml.j2
 34ce70d 


Diff: https://reviews.apache.org/r/58797/diff/2/

Changes: https://reviews.apache.org/r/58797/diff/1-2/


Testing
---

Verified fresh install on Cent-OS 6.


Thanks,

Vishal Suvagia



Review Request 58801: Unify repository file creation

2017-04-27 Thread Nate Cole

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58801/
---

Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.


Bugs: AMBARI-20871
https://issues.apache.org/jira/browse/AMBARI-20871


Repository: ambari


Description
---

We have 2 different ways of creating repositories - one is creating a new file 
for each repo definition (standard installation) and one file containing 
multiple repo definitions (install_packages).  These should both be done the 
same way (the install_packages way).


Diffs
-

  
ambari-common/src/main/python/resource_management/libraries/functions/repository_util.py
 PRE-CREATION 
  
ambari-server/src/main/java/org/apache/ambari/server/agent/CommandRepository.java
 PRE-CREATION 
  
ambari-server/src/main/java/org/apache/ambari/server/agent/ExecutionCommand.java
 8c726a0f2d 
  
ambari-server/src/main/java/org/apache/ambari/server/api/services/stackadvisor/commands/StackAdvisorCommand.java
 74a2cf2e32 
  
ambari-server/src/main/java/org/apache/ambari/server/bootstrap/DistributeRepositoriesStructuredOutput.java
 662b856c05 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/ActionExecutionContext.java
 3681eda976 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariActionExecutionHelper.java
 d556b603a8 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariCustomCommandExecutionHelper.java
 ab8b65968e 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariManagementControllerImpl.java
 751ce085d8 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/internal/ClusterStackVersionResourceProvider.java
 e39588ed42 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/internal/HostStackVersionResourceProvider.java
 811ce9b8cb 
  
ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/RepositoryVersionHelper.java
 fdb7c8d9b8 
  ambari-server/src/main/resources/custom_actions/scripts/install_packages.py 
33adce1414 
  
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/params.py
 6193c11c22 
  
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/repo_initialization.py
 a35dce757e 
  
ambari-server/src/test/java/org/apache/ambari/server/controller/internal/ClusterStackVersionResourceProviderTest.java
 8f7b31ddea 
  
ambari-server/src/test/java/org/apache/ambari/server/controller/internal/HostStackVersionResourceProviderTest.java
 4bed482f8d 
  
ambari-server/src/test/java/org/apache/ambari/server/serveraction/upgrades/UpgradeActionTest.java
 c6ee87588c 
  ambari-server/src/test/python/custom_actions/TestInstallPackages.py 
77e3bee3f6 
  
ambari-server/src/test/python/custom_actions/configs/install_packages_repository_file.json
 PRE-CREATION 
  ambari-server/src/test/python/stacks/2.0.6/configs/repository_file.json 
PRE-CREATION 
  
ambari-server/src/test/python/stacks/2.0.6/hooks/before-INSTALL/test_before_install.py
 082d2001cf 


Diff: https://reviews.apache.org/r/58801/diff/1/


Testing
---

Manual for both centos6 and ubuntu14.  Automated pending.


Thanks,

Nate Cole



Review Request 58800: Changes to events format

2017-04-27 Thread Andrew Onischuk

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58800/
---

Review request for Ambari, Alejandro Fernandez, Myroslav Papirkovskyy, and Sid 
Wagle.


Bugs: AMBARI-20869
https://issues.apache.org/jira/browse/AMBARI-20869


Repository: ambari


Description
---

Changes we discussed with Myroslav Papyrkovskyy to format data in more suitable
for server way.

  * use cluster id instead of name
  * remove some dictionary keys in events to make handing them simpler
  * don't use component name as key in topology dictionary to be ready for 
multiInstances work.


Diffs
-

  ambari-agent/src/main/python/ambari_agent/ClusterCache.py d5e724c 
  ambari-agent/src/main/python/ambari_agent/ClusterConfigurationCache.py 
03e9645 
  ambari-agent/src/main/python/ambari_agent/ComponentStatusExecutor.py 70cd82a 
  ambari-agent/src/main/python/ambari_agent/Constants.py 5ea916c 
  ambari-agent/src/main/python/ambari_agent/HeartbeatThread.py 6b68f27 
  ambari-agent/src/main/python/ambari_agent/Utils.py 456b2b3 
  ambari-agent/src/test/python/ambari_agent/TestAgentStompResponses.py 7ea0646 
  
ambari-agent/src/test/python/ambari_agent/dummy_files/stomp/components_status_report.json
 c1ce406 
  
ambari-agent/src/test/python/ambari_agent/dummy_files/stomp/configurations_update.json
 41cef61 
  
ambari-agent/src/test/python/ambari_agent/dummy_files/stomp/execution_commands.json
 1eeeb7c 
  
ambari-agent/src/test/python/ambari_agent/dummy_files/stomp/metadata_after_registration.json
 8ccd8e8 
  
ambari-agent/src/test/python/ambari_agent/dummy_files/stomp/metadata_update.json
 96b929b 
  
ambari-agent/src/test/python/ambari_agent/dummy_files/stomp/registration_request.json
 64077b3 
  
ambari-agent/src/test/python/ambari_agent/dummy_files/stomp/registration_response.json
 f744410 
  
ambari-agent/src/test/python/ambari_agent/dummy_files/stomp/topology_update.json
 291249c 


Diff: https://reviews.apache.org/r/58800/diff/1/


Testing
---

mvn clean test


Thanks,

Andrew Onischuk



Review Request 58798: AMBARI-20873 : Atlas gc-worker logs are not generated due to incorrect configuration

2017-04-27 Thread Vishal Suvagia via Review Board

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58798/
---

Review request for Ambari, Alejandro Fernandez, Gautam Borad, Madhan Neethiraj, 
Mugdha Varadkar, and Sumit Mohanty.


Bugs: AMBARI-20873
https://issues.apache.org/jira/browse/AMBARI-20873


Repository: ambari


Description
---

Atlas gc-worker logs are not generated due to missing / in atlas configurations.
Currently it is set as -Xloggc:$ATLAS_LOG_DIRgc-worker.log it should actually 
be -Xloggc:$ATLAS_LOG_DIR/gc-worker.log


Diffs
-

  
ambari-server/src/main/resources/stacks/HDP/2.5/services/ATLAS/configuration/atlas-env.xml
 bd0da9f 
  ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml 
1c2ceff 
  
ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.5.xml
 be8b750 
  
ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.6.xml
 d822778 
  ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.5.xml 
210c4e2 
  ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.6.xml 
9a06dd0 
  ambari-server/src/main/resources/stacks/HDP/2.6/upgrades/config-upgrade.xml 
f5d87e9 
  
ambari-server/src/main/resources/stacks/HDP/2.6/upgrades/nonrolling-upgrade-2.6.xml
 f7c276b 
  ambari-server/src/main/resources/stacks/HDP/2.6/upgrades/upgrade-2.6.xml 
81757c1 


Diff: https://reviews.apache.org/r/58798/diff/1/


Testing
---

Verified fresh install and upgrade on Cent-OS 6.


Thanks,

Vishal Suvagia



Re: Review Request 58797: AMBARI-20868 : Ranger admin start fails when Ambari Infra is turned off.

2017-04-27 Thread Oliver Szabo

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58797/#review173196
---




ambari-server/src/main/resources/common-services/RANGER/0.4.0/package/scripts/setup_ranger_xml.py
Lines 746 (patched)


it catches the error during collection creation, but this can be fail at 
where solr_cloud_util.add_solr_roles is called as well (it uses solr rest api, 
if solr is down, that can fail)


- Oliver Szabo


On April 27, 2017, 2:04 p.m., Vishal Suvagia wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58797/
> ---
> 
> (Updated April 27, 2017, 2:04 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Gautam Borad, Mugdha 
> Varadkar, Oliver Szabo, and Velmurugan Periasamy.
> 
> 
> Bugs: AMBARI-20868
> https://issues.apache.org/jira/browse/AMBARI-20868
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Ranger Admin start fails when Ambari Infra or External Solr service is down,. 
> need to handle errors and ensure Ranger start works, despite solr service 
> being down.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/common-services/RANGER/0.4.0/package/scripts/setup_ranger_xml.py
>  e56a705 
>   
> ambari-server/src/main/resources/common-services/RANGER/0.7.0/properties/ranger-solrconfig.xml.j2
>  34ce70d 
> 
> 
> Diff: https://reviews.apache.org/r/58797/diff/1/
> 
> 
> Testing
> ---
> 
> Verified fresh install on Cent-OS 6.
> 
> 
> Thanks,
> 
> Vishal Suvagia
> 
>



Review Request 58797: AMBARI-20868 : Ranger admin start fails when Ambari Infra is turned off.

2017-04-27 Thread Vishal Suvagia via Review Board

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58797/
---

Review request for Ambari, Alejandro Fernandez, Gautam Borad, Mugdha Varadkar, 
Oliver Szabo, and Velmurugan Periasamy.


Bugs: AMBARI-20868
https://issues.apache.org/jira/browse/AMBARI-20868


Repository: ambari


Description
---

Ranger Admin start fails when Ambari Infra or External Solr service is down,. 
need to handle errors and ensure Ranger start works, despite solr service being 
down.


Diffs
-

  
ambari-server/src/main/resources/common-services/RANGER/0.4.0/package/scripts/setup_ranger_xml.py
 e56a705 
  
ambari-server/src/main/resources/common-services/RANGER/0.7.0/properties/ranger-solrconfig.xml.j2
 34ce70d 


Diff: https://reviews.apache.org/r/58797/diff/1/


Testing
---

Verified fresh install on Cent-OS 6.


Thanks,

Vishal Suvagia



Re: Review Request 58735: The default value for sun.security.krb5.debug property is set to false.

2017-04-27 Thread Laszlo Puskas

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58735/
---

(Updated April 27, 2017, 1:36 p.m.)


Review request for Ambari, Robert Levas and Sandor Magyari.


Bugs: AMBARI-20849
https://issues.apache.org/jira/browse/AMBARI-20849


Repository: ambari


Description
---

When enabling kerberos for a cluster containing KNOX the amount of loges 
generated is too high by default.


Diffs
-

  
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/configuration/gateway-site.xml
 ad599e0 


Diff: https://reviews.apache.org/r/58735/diff/1/


Testing
---

Deployed a cluster locally. Checked the value of the property on the knox 
configuration page.
Unit tests successfully ran.


Thanks,

Laszlo Puskas



Re: Review Request 58735: The default value for sun.security.krb5.debug property is set to false.

2017-04-27 Thread Laszlo Puskas


> On April 26, 2017, 6:36 p.m., Alejandro Fernandez wrote:
> > ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/configuration/gateway-site.xml
> > Line 61 (original), 61 (patched)
> > 
> >
> > Does this value have to change for existing clusters?
> > If so, should an Ambari Upgrade modify the property if unkerberized.
> 
> Robert Levas wrote:
> I don't think that we need to change this for existing clusters.. maybe 
> the users expect the logs to be there since it was turned on from the 
> beginning.  
> 
> If Kerberos is not enabled (or was disabled), then no logging will be 
> done... so the value of the property is irrelevant (when Kerberos is not 
> enabled).

This value can also be changed from the UI. I don't think this change can be 
critical to existing clusters.


- Laszlo


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58735/#review173072
---


On April 27, 2017, 1:15 p.m., Laszlo Puskas wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58735/
> ---
> 
> (Updated April 27, 2017, 1:15 p.m.)
> 
> 
> Review request for Ambari, Robert Levas and Sandor Magyari.
> 
> 
> Bugs: AMBARI-20849
> https://issues.apache.org/jira/browse/AMBARI-20849
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> When enabling kerberos for a cluster containing KNOX the amount of loges 
> generated is too high by default.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/configuration/gateway-site.xml
>  ad599e0 
> 
> 
> Diff: https://reviews.apache.org/r/58735/diff/1/
> 
> 
> Testing
> ---
> 
> Deployed a cluster locally. Checked the value of the property on the knox 
> configuration page.
> Unit tests successfully ran.
> 
> 
> Thanks,
> 
> Laszlo Puskas
> 
>



Re: Review Request 58735: The default value for sun.security.krb5.debug property is set to false.

2017-04-27 Thread Laszlo Puskas

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58735/
---

(Updated April 27, 2017, 1:15 p.m.)


Review request for Ambari, Robert Levas and Sandor Magyari.


Summary (updated)
-

The default value for sun.security.krb5.debug property is set to false.


Bugs: AMBARI-20849
https://issues.apache.org/jira/browse/AMBARI-20849


Repository: ambari


Description
---

When enabling kerberos for a cluster containing KNOX the amount of loges 
generated is too high by default.


Diffs
-

  
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/configuration/gateway-site.xml
 ad599e0 


Diff: https://reviews.apache.org/r/58735/diff/1/


Testing
---

Deployed a cluster locally. Checked the value of the property on the knox 
configuration page.
Unit tests successfully ran.


Thanks,

Laszlo Puskas



Re: Review Request 58575: Ambari Metrics Storm Sink compilation error due to storm-1.1.0-SNAPSHOT

2017-04-27 Thread Masahiro Tanaka

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58575/#review173189
---



Could anyone review this?

- Masahiro Tanaka


On April 20, 2017, 11:59 p.m., Masahiro Tanaka wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58575/
> ---
> 
> (Updated April 20, 2017, 11:59 p.m.)
> 
> 
> Review request for Ambari, Aravindan Vijayan, Sid Wagle, and Yusaku Sako.
> 
> 
> Bugs: AMBARI-20797
> https://issues.apache.org/jira/browse/AMBARI-20797
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> I had in trouble compiling same as in 
> https://community.hortonworks.com/questions/93448/compile-ambari-metrics-storm-sink-error.html
> The solution is also mentioned in the URL above. We should use storm-1.1.0 , 
> not storm-1.1.0-SNAPSHOT
> 
> 
> Diffs
> -
> 
>   ambari-metrics/ambari-metrics-storm-sink/pom.xml 612ad63 
> 
> 
> Diff: https://reviews.apache.org/r/58575/diff/1/
> 
> 
> Testing
> ---
> 
> -1 overall. Here are the results of testing the latest attachment 
> http://issues.apache.org/jira/secure/attachment/12864239/AMBARI-20797.0.patch
> against trunk revision .
> +1 @author. The patch does not contain any @author tags.
> -1 tests included. The patch doesn't appear to include any new or modified 
> tests.
> Please justify why no new tests are needed for this patch.
> Also please list what manual steps were performed to verify this patch.
> +1 release audit. The applied patch does not increase the total number of 
> release audit warnings.
> +1 javac. The applied patch does not increase the total number of javac 
> compiler warnings.
> +1 core tests. The patch passed unit tests in 
> ambari-metrics/ambari-metrics-storm-sink.
> Test results: 
> https://builds.apache.org/job/Ambari-trunk-test-patch/11419//testReport/
> Console output: 
> https://builds.apache.org/job/Ambari-trunk-test-patch/11419//console
> This message is automatically generated.
> 
> 
> Thanks,
> 
> Masahiro Tanaka
> 
>



Re: Review Request 58735: The default value for sun.security.krb5.debug property is set to fals.

2017-04-27 Thread Laszlo Puskas

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58735/
---

(Updated April 27, 2017, 1:03 p.m.)


Review request for Ambari, Robert Levas and Sandor Magyari.


Bugs: AMBARI-20849
https://issues.apache.org/jira/browse/AMBARI-20849


Repository: ambari


Description
---

When enabling kerberos for a cluster containing KNOX the amount of loges 
generated is too high by default.


Diffs
-

  
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/configuration/gateway-site.xml
 ad599e0 


Diff: https://reviews.apache.org/r/58735/diff/1/


Testing (updated)
---

Deployed a cluster locally. Checked the value of the property on the knox 
configuration page.
Unit tests successfully ran.


Thanks,

Laszlo Puskas



Re: Review Request 58735: The default value for sun.security.krb5.debug property is set to fals.

2017-04-27 Thread Laszlo Puskas

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58735/
---

(Updated April 27, 2017, 12:25 p.m.)


Review request for Ambari, Robert Levas and Sandor Magyari.


Bugs: AMBARI-20849
https://issues.apache.org/jira/browse/AMBARI-20849


Repository: ambari


Description
---

When enabling kerberos for a cluster containing KNOX the amount of loges 
generated is too high by default.


Diffs
-

  
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/configuration/gateway-site.xml
 ad599e0 


Diff: https://reviews.apache.org/r/58735/diff/1/


Testing (updated)
---

Deployed a cluster locally. Checked the value of the property on the knox 
configuration page.
Unit tests running ...


Thanks,

Laszlo Puskas



Re: Review Request 58735: The default value for sun.security.krb5.debug property is set to fals.

2017-04-27 Thread Laszlo Puskas

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58735/
---

(Updated April 27, 2017, 12:22 p.m.)


Review request for Ambari, Robert Levas and Sandor Magyari.


Bugs: AMBARI-20849
https://issues.apache.org/jira/browse/AMBARI-20849


Repository: ambari


Description
---

When enabling kerberos for a cluster containing KNOX the amount of loges 
generated is too high by default.


Diffs
-

  
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/configuration/gateway-site.xml
 ad599e0 


Diff: https://reviews.apache.org/r/58735/diff/1/


Testing (updated)
---

Deployed a cluster locally. Checked the value of the property on the knox 
configuration page.


Thanks,

Laszlo Puskas



Re: Review Request 58790: Create an ansynchronious status commands executor

2017-04-27 Thread Myroslav Papirkovskyy

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58790/#review173185
---


Ship it!




Ship It!

- Myroslav Papirkovskyy


On Квітень 27, 2017, 1:55 після полудня, Andrew Onischuk wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58790/
> ---
> 
> (Updated Квітень 27, 2017, 1:55 після полудня)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Myroslav Papirkovskyy, and 
> Sid Wagle.
> 
> 
> Bugs: AMBARI-20830
> https://issues.apache.org/jira/browse/AMBARI-20830
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> status commands queue should be generated from the topology information
> received from server and be maintained even if server goes down.
> 
> 
> Diffs
> -
> 
>   ambari-agent/src/main/python/ambari_agent/ClusterCache.py 4bd94ae 
>   ambari-agent/src/main/python/ambari_agent/ComponentStatusExecutor.py 
> PRE-CREATION 
>   ambari-agent/src/main/python/ambari_agent/Constants.py 50fac9e 
>   ambari-agent/src/main/python/ambari_agent/HeartbeatThread.py 63674d5 
>   ambari-agent/src/main/python/ambari_agent/InitializerModule.py 76d14e5 
>   ambari-agent/src/main/python/ambari_agent/Utils.py 6e919c0 
>   ambari-agent/src/test/python/ambari_agent/TestAgentStompResponses.py 
> f5caa7b 
> 
> 
> Diff: https://reviews.apache.org/r/58790/diff/1/
> 
> 
> Testing
> ---
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Andrew Onischuk
> 
>



Re: Review Request 58785: AMBARI-20867.Cleanup Jsplumb specific code from WFM

2017-04-27 Thread belliraj hb

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58785/#review173177
---


Ship it!




Ship It!

- belliraj hb


On April 27, 2017, 9:24 a.m., Padma Priya N wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58785/
> ---
> 
> (Updated April 27, 2017, 9:24 a.m.)
> 
> 
> Review request for Ambari, belliraj hb, Gaurav Nagar, Pallav Kulshreshtha, 
> and venkat sairam.
> 
> 
> Bugs: AMBARI-20867
> https://issues.apache.org/jira/browse/AMBARI-20867
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Removed jsplumb dependency from bower and deleted unused jsplumb related code.
> 
> 
> Diffs
> -
> 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/components/flow-designer.js 
> 17f21ee 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/domain/jsplumb-flow-renderer.js
>  c3e3133 
>   contrib/views/wfmanager/src/main/resources/ui/app/domain/layout-manager1.js 
> 0cd306a 
>   contrib/views/wfmanager/src/main/resources/ui/app/domain/layout-manager2.js 
> d82b89e 
>   contrib/views/wfmanager/src/main/resources/ui/bower.json 7e1709b 
> 
> 
> Diff: https://reviews.apache.org/r/58785/diff/1/
> 
> 
> Testing
> ---
> 
> Manual Testing
> 
> 
> Thanks,
> 
> Padma Priya N
> 
>



Review Request 58785: AMBARI-20867.Cleanup Jsplumb specific code from WFM

2017-04-27 Thread Padma Priya N

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58785/
---

Review request for Ambari, belliraj hb, Gaurav Nagar, Pallav Kulshreshtha, and 
venkat sairam.


Bugs: AMBARI-20867
https://issues.apache.org/jira/browse/AMBARI-20867


Repository: ambari


Description
---

Removed jsplumb dependency from bower and deleted unused jsplumb related code.


Diffs
-

  contrib/views/wfmanager/src/main/resources/ui/app/components/flow-designer.js 
17f21ee 
  
contrib/views/wfmanager/src/main/resources/ui/app/domain/jsplumb-flow-renderer.js
 c3e3133 
  contrib/views/wfmanager/src/main/resources/ui/app/domain/layout-manager1.js 
0cd306a 
  contrib/views/wfmanager/src/main/resources/ui/app/domain/layout-manager2.js 
d82b89e 
  contrib/views/wfmanager/src/main/resources/ui/bower.json 7e1709b 


Diff: https://reviews.apache.org/r/58785/diff/1/


Testing
---

Manual Testing


Thanks,

Padma Priya N



Re: Review Request 58784: AMBARI-20866.Distcp should take a single command rather than list of arguments to make it easier ot use.

2017-04-27 Thread belliraj hb

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58784/#review173173
---


Ship it!




Ship It!

- belliraj hb


On April 27, 2017, 8:56 a.m., Padma Priya N wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58784/
> ---
> 
> (Updated April 27, 2017, 8:56 a.m.)
> 
> 
> Review request for Ambari, belliraj hb, Gaurav Nagar, Pallav Kulshreshtha, 
> and venkat sairam.
> 
> 
> Bugs: AMBARI-20866
> https://issues.apache.org/jira/browse/AMBARI-20866
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Replaces the args list with a text area where the user can type the distcp 
> args.
> 
> 
> Diffs
> -
> 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/components/distcp-action.js 
> e5740e3 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/distcp-action.hbs
>  28e67da 
> 
> 
> Diff: https://reviews.apache.org/r/58784/diff/1/
> 
> 
> Testing
> ---
> 
> Manual Testing
> 
> 
> Thanks,
> 
> Padma Priya N
> 
>



Re: Review Request 58784: AMBARI-20866.Distcp should take a single command rather than list of arguments to make it easier ot use.

2017-04-27 Thread Gaurav Nagar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58784/#review173172
---


Ship it!




Ship It!

- Gaurav Nagar


On April 27, 2017, 8:56 a.m., Padma Priya N wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58784/
> ---
> 
> (Updated April 27, 2017, 8:56 a.m.)
> 
> 
> Review request for Ambari, belliraj hb, Gaurav Nagar, Pallav Kulshreshtha, 
> and venkat sairam.
> 
> 
> Bugs: AMBARI-20866
> https://issues.apache.org/jira/browse/AMBARI-20866
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Replaces the args list with a text area where the user can type the distcp 
> args.
> 
> 
> Diffs
> -
> 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/components/distcp-action.js 
> e5740e3 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/distcp-action.hbs
>  28e67da 
> 
> 
> Diff: https://reviews.apache.org/r/58784/diff/1/
> 
> 
> Testing
> ---
> 
> Manual Testing
> 
> 
> Thanks,
> 
> Padma Priya N
> 
>



Review Request 58784: AMBARI-20866.Distcp should take a single command rather than list of arguments to make it easier ot use.

2017-04-27 Thread Padma Priya N

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58784/
---

Review request for Ambari, belliraj hb, Gaurav Nagar, Pallav Kulshreshtha, and 
venkat sairam.


Bugs: AMBARI-20866
https://issues.apache.org/jira/browse/AMBARI-20866


Repository: ambari


Description
---

Replaces the args list with a text area where the user can type the distcp args.


Diffs
-

  contrib/views/wfmanager/src/main/resources/ui/app/components/distcp-action.js 
e5740e3 
  
contrib/views/wfmanager/src/main/resources/ui/app/templates/components/distcp-action.hbs
 28e67da 


Diff: https://reviews.apache.org/r/58784/diff/1/


Testing
---

Manual Testing


Thanks,

Padma Priya N



Re: Review Request 58695: HIVE 2 -UX changes- Part1

2017-04-27 Thread Nitiraj Rathore

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58695/#review173167
---


Ship it!




Ship It!

- Nitiraj Rathore


On April 27, 2017, 6:10 a.m., Pallav Kulshreshtha wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58695/
> ---
> 
> (Updated April 27, 2017, 6:10 a.m.)
> 
> 
> Review request for Ambari, DIPAYAN BHOWMICK, Gaurav Nagar, Nitiraj Rathore, 
> Rohit Choudhary, and venkat sairam.
> 
> 
> Bugs: AMBARI-20842
> https://issues.apache.org/jira/browse/AMBARI-20842
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Made CSS related chages.
> 
> 
> Diffs
> -
> 
>   contrib/views/hive20/src/main/resources/ui/app/components/udf-item.js 
> 6005444 
>   contrib/views/hive20/src/main/resources/ui/app/styles/app.scss ca3bc98 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/jobs-browser.hbs
>  014691e 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/notification-message.hbs
>  c2b32a1 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/table-rename-form.hbs
>  b692a9c 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/table-statistics.hbs
>  cdcf762 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/udf-edit.hbs
>  24cb495 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/udf-item.hbs
>  929b91a 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/udf-new.hbs
>  ddf34d7 
>   contrib/views/hive20/src/main/resources/ui/app/templates/databases.hbs 
> ecedef5 
>   contrib/views/hive20/src/main/resources/ui/app/templates/queries/query.hbs 
> 989cfc3 
>   contrib/views/hive20/src/main/resources/ui/app/templates/savedqueries.hbs 
> c0b5e82 
>   contrib/views/hive20/src/main/resources/ui/app/templates/udfs.hbs ef6a01c 
> 
> 
> Diff: https://reviews.apache.org/r/58695/diff/2/
> 
> 
> Testing
> ---
> 
> manually tested.
> 
> 
> Thanks,
> 
> Pallav Kulshreshtha
> 
>



Re: Review Request 58618: First node in the visual explain chart is not clickable to view the json dump

2017-04-27 Thread Gaurav Nagar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58618/#review173163
---


Ship it!




Ship It!

- Gaurav Nagar


On April 21, 2017, 1:36 p.m., Pallav Kulshreshtha wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58618/
> ---
> 
> (Updated April 21, 2017, 1:36 p.m.)
> 
> 
> Review request for Ambari, DIPAYAN BHOWMICK, Gaurav Nagar, Nitiraj Rathore, 
> Rohit Choudhary, and venkat sairam.
> 
> 
> Bugs: AMBARI-20817
> https://issues.apache.org/jira/browse/AMBARI-20817
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Increased the first node height.
> 
> 
> Diffs
> -
> 
>   
> contrib/views/hive20/src/main/resources/ui/app/utils/hive-explainer/renderer.js
>  78aa39d 
> 
> 
> Diff: https://reviews.apache.org/r/58618/diff/1/
> 
> 
> Testing
> ---
> 
> manually tedted.
> 
> 
> Thanks,
> 
> Pallav Kulshreshtha
> 
>



Re: Review Request 58618: First node in the visual explain chart is not clickable to view the json dump

2017-04-27 Thread venkat sairam

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58618/#review173162
---


Ship it!




Ship It!

- venkat sairam


On April 21, 2017, 1:36 p.m., Pallav Kulshreshtha wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58618/
> ---
> 
> (Updated April 21, 2017, 1:36 p.m.)
> 
> 
> Review request for Ambari, DIPAYAN BHOWMICK, Gaurav Nagar, Nitiraj Rathore, 
> Rohit Choudhary, and venkat sairam.
> 
> 
> Bugs: AMBARI-20817
> https://issues.apache.org/jira/browse/AMBARI-20817
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Increased the first node height.
> 
> 
> Diffs
> -
> 
>   
> contrib/views/hive20/src/main/resources/ui/app/utils/hive-explainer/renderer.js
>  78aa39d 
> 
> 
> Diff: https://reviews.apache.org/r/58618/diff/1/
> 
> 
> Testing
> ---
> 
> manually tedted.
> 
> 
> Thanks,
> 
> Pallav Kulshreshtha
> 
>



Re: Review Request 58695: HIVE 2 -UX changes- Part1

2017-04-27 Thread venkat sairam

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58695/#review173161
---


Ship it!




Ship It!

- venkat sairam


On April 27, 2017, 6:10 a.m., Pallav Kulshreshtha wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58695/
> ---
> 
> (Updated April 27, 2017, 6:10 a.m.)
> 
> 
> Review request for Ambari, DIPAYAN BHOWMICK, Gaurav Nagar, Nitiraj Rathore, 
> Rohit Choudhary, and venkat sairam.
> 
> 
> Bugs: AMBARI-20842
> https://issues.apache.org/jira/browse/AMBARI-20842
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Made CSS related chages.
> 
> 
> Diffs
> -
> 
>   contrib/views/hive20/src/main/resources/ui/app/components/udf-item.js 
> 6005444 
>   contrib/views/hive20/src/main/resources/ui/app/styles/app.scss ca3bc98 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/jobs-browser.hbs
>  014691e 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/notification-message.hbs
>  c2b32a1 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/table-rename-form.hbs
>  b692a9c 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/table-statistics.hbs
>  cdcf762 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/udf-edit.hbs
>  24cb495 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/udf-item.hbs
>  929b91a 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/udf-new.hbs
>  ddf34d7 
>   contrib/views/hive20/src/main/resources/ui/app/templates/databases.hbs 
> ecedef5 
>   contrib/views/hive20/src/main/resources/ui/app/templates/queries/query.hbs 
> 989cfc3 
>   contrib/views/hive20/src/main/resources/ui/app/templates/savedqueries.hbs 
> c0b5e82 
>   contrib/views/hive20/src/main/resources/ui/app/templates/udfs.hbs ef6a01c 
> 
> 
> Diff: https://reviews.apache.org/r/58695/diff/2/
> 
> 
> Testing
> ---
> 
> manually tested.
> 
> 
> Thanks,
> 
> Pallav Kulshreshtha
> 
>



Re: Review Request 58780: WFM: Clicking search icon in workflow dashboard throws error

2017-04-27 Thread Padma Priya N

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58780/#review173160
---




contrib/views/wfmanager/src/main/resources/ui/app/components/search-create-new-bar.js
Lines 193 (patched)


It is better to use Ember.isBlank() instead of !=


- Padma Priya N


On April 27, 2017, 5:59 a.m., Anita Jebaraj wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58780/
> ---
> 
> (Updated April 27, 2017, 5:59 a.m.)
> 
> 
> Review request for Ambari, belliraj hb, Di Li, DIPAYAN BHOWMICK, Padma Priya 
> N, and Sangeeta Ravindran.
> 
> 
> Bugs: AMBARI-20850
> https://issues.apache.org/jira/browse/AMBARI-20850
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Clicking on search icon when the filter is empty in workflow dashboard throws 
> the error Remote API failed as in screenshot
> 
> 
> Diffs
> -
> 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/components/search-create-new-bar.js
>  7e69dea 
> 
> 
> Diff: https://reviews.apache.org/r/58780/diff/1/
> 
> 
> Testing
> ---
> 
> Tested Manually
> 
> 
> File Attachments
> 
> 
> error
>   
> https://reviews.apache.org/media/uploaded/files/2017/04/27/6027e0bc-d946-4d10-80b1-440486278022__wf-error.jpg
> 
> 
> Thanks,
> 
> Anita Jebaraj
> 
>



Re: Review Request 58744: Bulk action is not functional in workflow dashboard

2017-04-27 Thread Padma Priya N

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58744/#review173159
---


Ship it!




Ship It!

- Padma Priya N


On April 26, 2017, 6:19 p.m., venkat sairam wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58744/
> ---
> 
> (Updated April 26, 2017, 6:19 p.m.)
> 
> 
> Review request for Ambari, belliraj hb, Gaurav Nagar, Padma Priya N, Pallav 
> Kulshreshtha, and Rohit Choudhary.
> 
> 
> Bugs: AMBARI-20703
> https://issues.apache.org/jira/browse/AMBARI-20703
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Bulk action have been commented out as it causes performance issues
> 
> 
> Diffs
> -
> 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/job-row.hbs
>  4c18d5d 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/search-table.hbs
>  7b5a625 
> 
> 
> Diff: https://reviews.apache.org/r/58744/diff/1/
> 
> 
> Testing
> ---
> 
> Manual testing done
> 
> 
> Thanks,
> 
> venkat sairam
> 
>



Re: Review Request 58497: AMBARI-20779 Create Ranger KMS HDFS audit folder as part of install

2017-04-27 Thread Mugdha Varadkar


> On April 26, 2017, 6:37 p.m., Alejandro Fernandez wrote:
> > ambari-server/src/main/resources/common-services/RANGER_KMS/0.5.0.2.3/package/scripts/kms.py
> > Lines 510 (patched)
> > 
> >
> > I think you still need has_hdfs_client_on_node

Hi Alejandro,

create_kms_audit_dir is calcluated using security_enabled and 
has_hdfs_client_on_node flags, if has_hdfs_client_on_node is false then 
create_kms_audit_dir will be false, so the resulting HDFS resource will not be 
created.


- Mugdha


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58497/#review173073
---


On April 26, 2017, 9:56 a.m., Mugdha Varadkar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/58497/
> ---
> 
> (Updated April 26, 2017, 9:56 a.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Gautam Borad, Sumit Mohanty, 
> and Velmurugan Periasamy.
> 
> 
> Bugs: AMBARI-20779
> https://issues.apache.org/jira/browse/AMBARI-20779
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Create audit directory /ranger/audit/kms in hdfs, if 
> xasecure.audit.destination.hdfs (Audit To HDFS) property is set to true.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/common-services/RANGER/0.5.0/role_command_order.json
>  df62dfd 
>   
> ambari-server/src/main/resources/common-services/RANGER_KMS/0.5.0.2.3/metainfo.xml
>  b20201c 
>   
> ambari-server/src/main/resources/common-services/RANGER_KMS/0.5.0.2.3/package/scripts/kms.py
>  423cdec 
>   
> ambari-server/src/main/resources/common-services/RANGER_KMS/0.5.0.2.3/package/scripts/params.py
>  9fe0a61 
>   
> ambari-server/src/main/resources/common-services/RANGER_KMS/0.5.0.2.3/role_command_order.json
>  006d177 
>   ambari-server/src/main/resources/stacks/HDP/2.3/role_command_order.json 
> 4f279c6 
>   ambari-server/src/test/python/stacks/2.5/RANGER_KMS/test_kms_server.py 
> 7082a33 
>   ambari-server/src/test/python/stacks/2.5/configs/ranger-kms-secured.json 
> 7054e8f 
> 
> 
> Diff: https://reviews.apache.org/r/58497/diff/3/
> 
> 
> Testing
> ---
> 
> Unit Test Result:
> 
> Running tests for stack:2.5 service:RANGER_KMS
> test_configure_default (test_kms_server.TestRangerKMS) ... 2017-04-18 
> 13:13:22,030 - Stack Feature Version Info: stack_version=2.5, 
> version=2.5.0.0-777, current_cluster_version=2.5.0.0-777 -> 2.5.0.0-777
> 2017-04-18 13:13:22,046 - Using hadoop conf dir: 
> /usr/hdp/current/hadoop-client/conf
> ok
> test_configure_secured (test_kms_server.TestRangerKMS) ... 2017-04-18 
> 13:13:22,062 - Stack Feature Version Info: stack_version=2.5, 
> version=2.5.0.0-801, current_cluster_version=2.5.0.0-801 -> 2.5.0.0-801
> 2017-04-18 13:13:22,080 - Using hadoop conf dir: 
> /usr/hdp/current/hadoop-client/conf
> ok
> test_start_default (test_kms_server.TestRangerKMS) ... 2017-04-18 
> 13:13:22,095 - Stack Feature Version Info: stack_version=2.5, 
> version=2.5.0.0-777, current_cluster_version=2.5.0.0-777 -> 2.5.0.0-777
> 2017-04-18 13:13:22,111 - Using hadoop conf dir: 
> /usr/hdp/current/hadoop-client/conf
> 2017-04-18 13:13:22,116 - Rangeradmin: Skip ranger admin if it's down !
> ok
> test_start_secured (test_kms_server.TestRangerKMS) ... 2017-04-18 
> 13:13:22,129 - Stack Feature Version Info: stack_version=2.5, 
> version=2.5.0.0-801, current_cluster_version=2.5.0.0-801 -> 2.5.0.0-801
> 2017-04-18 13:13:22,145 - Using hadoop conf dir: 
> /usr/hdp/current/hadoop-client/conf
> 2017-04-18 13:13:22,150 - RangeradminV2: Skip ranger admin if it's down !
> 2017-04-18 13:13:22,151 - KMS repository c1_kms exist
> ok
> test_stop_default (test_kms_server.TestRangerKMS) ... 2017-04-18 13:13:22,163 
> - Stack Feature Version Info: stack_version=2.5, version=2.5.0.0-777, 
> current_cluster_version=2.5.0.0-777 -> 2.5.0.0-777
> 2017-04-18 13:13:22,179 - Using hadoop conf dir: 
> /usr/hdp/current/hadoop-client/conf
> ok
> 
> --
> Ran 5 tests in 0.164s
> 
> OK
> 
> 
> Thanks,
> 
> Mugdha Varadkar
> 
>