Re: Review Request 55664: AMBARI-19602:Input logic tags are missing in the coordinator xml

2017-01-17 Thread belliraj hb

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55664/#review162039
---


Ship it!




Ship It!

- belliraj hb


On Jan. 18, 2017, 7:15 a.m., Padma Priya N wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55664/
> ---
> 
> (Updated Jan. 18, 2017, 7:15 a.m.)
> 
> 
> Review request for Ambari, DIPAYAN BHOWMICK, Gaurav Nagar, Nitiraj Rathore, 
> and Pallav Kulshreshtha.
> 
> 
> Bugs: AMBARI-19602
> https://issues.apache.org/jira/browse/AMBARI-19602
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> 'Input-logic' tags are missing in the coordinator xml.
> Steps to reproduce :
> 1) Import a coordinator xml with input logic
> 2) Preview the xml.
> 3) Check that 'input-logic' tags which are available in original xml are 
> missing in the preview xml.
> 
> 
> Diffs
> -
> 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/components/coord-config.js 
> eb0d585 
>   contrib/views/wfmanager/src/main/resources/ui/app/components/job-config.js 
> 0979c25 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/domain/coordinator/coordinator-xml-importer.js
>  9b54495 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/coord-config.hbs
>  f906fd5 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/job-config.hbs
>  b33420a 
> 
> Diff: https://reviews.apache.org/r/55664/diff/
> 
> 
> Testing
> ---
> 
> Manual Testing
> 
> 
> Thanks,
> 
> Padma Priya N
> 
>



Re: Review Request 55664: AMBARI-19602:Input logic tags are missing in the coordinator xml

2017-01-17 Thread Nitiraj Rathore

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55664/#review162037
---


Ship it!




Ship It!

- Nitiraj Rathore


On Jan. 18, 2017, 7:15 a.m., Padma Priya N wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55664/
> ---
> 
> (Updated Jan. 18, 2017, 7:15 a.m.)
> 
> 
> Review request for Ambari, DIPAYAN BHOWMICK, Gaurav Nagar, Nitiraj Rathore, 
> and Pallav Kulshreshtha.
> 
> 
> Bugs: AMBARI-19602
> https://issues.apache.org/jira/browse/AMBARI-19602
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> 'Input-logic' tags are missing in the coordinator xml.
> Steps to reproduce :
> 1) Import a coordinator xml with input logic
> 2) Preview the xml.
> 3) Check that 'input-logic' tags which are available in original xml are 
> missing in the preview xml.
> 
> 
> Diffs
> -
> 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/components/coord-config.js 
> eb0d585 
>   contrib/views/wfmanager/src/main/resources/ui/app/components/job-config.js 
> 0979c25 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/domain/coordinator/coordinator-xml-importer.js
>  9b54495 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/coord-config.hbs
>  f906fd5 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/job-config.hbs
>  b33420a 
> 
> Diff: https://reviews.apache.org/r/55664/diff/
> 
> 
> Testing
> ---
> 
> Manual Testing
> 
> 
> Thanks,
> 
> Padma Priya N
> 
>



Re: Review Request 55627: Hive view 2.0 REST and backend support for enabling and fetching table and column stats

2017-01-17 Thread Gaurav Nagar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55627/#review162036
---


Ship it!




Ship It!

- Gaurav Nagar


On Jan. 17, 2017, 4:18 p.m., Nitiraj Rathore wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55627/
> ---
> 
> (Updated Jan. 17, 2017, 4:18 p.m.)
> 
> 
> Review request for Ambari, DIPAYAN BHOWMICK, Gaurav Nagar, Pallav 
> Kulshreshtha, and Rohit Choudhary.
> 
> 
> Bugs: AMBARI-19584
> https://issues.apache.org/jira/browse/AMBARI-19584
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Info can be found at : 
> https://cwiki.apache.org/confluence/display/Hive/StatsDev#StatsDev-ColumnStatistics
> Requirements:
> 1. REST endpoint to enable statistics for a table with support for stats for 
> all columns -- done
> 2. REST endpoint to fetch table stats -- done : table stats will come with 
> table info itself
> 3. REST endpoint to fetch column stats -- done
> 
> 
> Diffs
> -
> 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/dto/ColumnInfo.java
>  2876348 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/dto/ColumnStats.java
>  PRE-CREATION 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/dto/TableMeta.java
>  f47e76c 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/dto/TableStats.java
>  PRE-CREATION 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/parsers/TableMetaParserImpl.java
>  5cae34a 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/query/generators/AnalyzeTableQueryGenerator.java
>  PRE-CREATION 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/query/generators/FetchColumnStatsQueryGenerator.java
>  PRE-CREATION 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/resources/browser/DDLProxy.java
>  8d995dd 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/resources/browser/DDLService.java
>  e142baf 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/resources/jobs/JobService.java
>  675ea37 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/resources/jobs/ResultsPaginationController.java
>  6efa2a9 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/resources/jobs/viewJobs/JobImpl.java
>  85ffaf2 
>   contrib/views/hive20/src/test/rest/postman/hive20.postman_collection.json 
> d674944 
> 
> Diff: https://reviews.apache.org/r/55627/diff/
> 
> 
> Testing
> ---
> 
> manual testing done.
> 
> 
> Thanks,
> 
> Nitiraj Rathore
> 
>



Review Request 55664: AMBARI-19602:Input logic tags are missing in the coordinator xml

2017-01-17 Thread Padma Priya N

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55664/
---

Review request for Ambari, DIPAYAN BHOWMICK, Gaurav Nagar, Nitiraj Rathore, and 
Pallav Kulshreshtha.


Bugs: AMBARI-19602
https://issues.apache.org/jira/browse/AMBARI-19602


Repository: ambari


Description
---

'Input-logic' tags are missing in the coordinator xml.
Steps to reproduce :
1) Import a coordinator xml with input logic
2) Preview the xml.
3) Check that 'input-logic' tags which are available in original xml are 
missing in the preview xml.


Diffs
-

  contrib/views/wfmanager/src/main/resources/ui/app/components/coord-config.js 
eb0d585 
  contrib/views/wfmanager/src/main/resources/ui/app/components/job-config.js 
0979c25 
  
contrib/views/wfmanager/src/main/resources/ui/app/domain/coordinator/coordinator-xml-importer.js
 9b54495 
  
contrib/views/wfmanager/src/main/resources/ui/app/templates/components/coord-config.hbs
 f906fd5 
  
contrib/views/wfmanager/src/main/resources/ui/app/templates/components/job-config.hbs
 b33420a 

Diff: https://reviews.apache.org/r/55664/diff/


Testing
---

Manual Testing


Thanks,

Padma Priya N



Re: Review Request 55614: AMBARI-19581. Need to show proper error message in scenarios of failures with asset import

2017-01-17 Thread Gaurav Nagar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55614/#review162033
---


Ship it!




Ship It!

- Gaurav Nagar


On Jan. 17, 2017, 12:02 p.m., Madhan Reddy wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55614/
> ---
> 
> (Updated Jan. 17, 2017, 12:02 p.m.)
> 
> 
> Review request for Ambari, belliraj hb, DIPAYAN BHOWMICK, Gaurav Nagar, 
> Nitiraj Rathore, and Pallav Kulshreshtha.
> 
> 
> Bugs: AMBARI-19581
> https://issues.apache.org/jira/browse/AMBARI-19581
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Need to show proper error message in scenarios of failures with asset import.
> While importing the asset for a given action node, its better to show only 
> assets belonging to that particular type.
> Steps to reproduce :
> 1) Save hive node settings as an asset.
> 2) Now try to import that setting for hive2 or node other than hive.
> 3) user is shown with the message 'Invalid asset settings'. 
> Either user should be shown only the assets of that particular type or 
> appropriate error message should be displayed as why import setting has 
> failed.
> 
> 
> Diffs
> -
> 
>   contrib/views/wfmanager/src/main/resources/ui/app/components/asset-list.js 
> 2ea82b0 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/components/flow-designer.js 
> d0c05d6 
>   contrib/views/wfmanager/src/main/resources/ui/app/styles/app.less bc0e419 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/asset-config.hbs
>  4ee6d05 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/asset-list.hbs
>  d377d2c 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/asset-manager.hbs
>  0fa86b0 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/flow-designer.hbs
>  80af968 
> 
> Diff: https://reviews.apache.org/r/55614/diff/
> 
> 
> Testing
> ---
> 
> Manual
> 
> 
> Thanks,
> 
> Madhan Reddy
> 
>



Re: Review Request 55627: Hive view 2.0 REST and backend support for enabling and fetching table and column stats

2017-01-17 Thread DIPAYAN BHOWMICK

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55627/#review162030
---


Ship it!




Ship It!

- DIPAYAN BHOWMICK


On Jan. 17, 2017, 4:18 p.m., Nitiraj Rathore wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55627/
> ---
> 
> (Updated Jan. 17, 2017, 4:18 p.m.)
> 
> 
> Review request for Ambari, DIPAYAN BHOWMICK, Gaurav Nagar, Pallav 
> Kulshreshtha, and Rohit Choudhary.
> 
> 
> Bugs: AMBARI-19584
> https://issues.apache.org/jira/browse/AMBARI-19584
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Info can be found at : 
> https://cwiki.apache.org/confluence/display/Hive/StatsDev#StatsDev-ColumnStatistics
> Requirements:
> 1. REST endpoint to enable statistics for a table with support for stats for 
> all columns -- done
> 2. REST endpoint to fetch table stats -- done : table stats will come with 
> table info itself
> 3. REST endpoint to fetch column stats -- done
> 
> 
> Diffs
> -
> 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/dto/ColumnInfo.java
>  2876348 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/dto/ColumnStats.java
>  PRE-CREATION 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/dto/TableMeta.java
>  f47e76c 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/dto/TableStats.java
>  PRE-CREATION 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/parsers/TableMetaParserImpl.java
>  5cae34a 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/query/generators/AnalyzeTableQueryGenerator.java
>  PRE-CREATION 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/query/generators/FetchColumnStatsQueryGenerator.java
>  PRE-CREATION 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/resources/browser/DDLProxy.java
>  8d995dd 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/resources/browser/DDLService.java
>  e142baf 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/resources/jobs/JobService.java
>  675ea37 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/resources/jobs/ResultsPaginationController.java
>  6efa2a9 
>   
> contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/resources/jobs/viewJobs/JobImpl.java
>  85ffaf2 
>   contrib/views/hive20/src/test/rest/postman/hive20.postman_collection.json 
> d674944 
> 
> Diff: https://reviews.apache.org/r/55627/diff/
> 
> 
> Testing
> ---
> 
> manual testing done.
> 
> 
> Thanks,
> 
> Nitiraj Rathore
> 
>



Re: Review Request 55129: [AMBARI-19337] Ambari has some spelling mistakes in YARN proxyuser properties in many places.

2017-01-17 Thread Sumit Mohanty


> On Jan. 17, 2017, 8:45 p.m., Alejandro Fernandez wrote:
> > ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/kerberos.json,
> >  line 26
> > 
> >
> > This is essentially changing the config name.
> > What should happen to existing clusters already Kerberized?
> > Should the propery be renamed?
> 
> Jay SenSharma wrote:
> If the property name itself is wrong in an existing cluster then i guess 
> it might not be working as expected earlier as well, because the YARN will 
> ignore those properties which are incorrect (non existing). So i think for 
> the existing clusters it needs to be corrected.
> 
> Please correct me if above statement is incorrect.

Lets open a separate JIRA to fix the properties during HDP upgrade. Chances are 
high that these clusters are fixed by the users as without the fixes they will 
see access issued.


- Sumit


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55129/#review161941
---


On Jan. 3, 2017, 8:41 a.m., Jay SenSharma wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55129/
> ---
> 
> (Updated Jan. 3, 2017, 8:41 a.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Jonathan Hurley, Nate Cole, 
> and Sid Wagle.
> 
> 
> Bugs: AMBARI-19337
> https://issues.apache.org/jira/browse/AMBARI-19337
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> YARN proxyusers properties has spelling mistake. For a long time the property 
> has ".proxyusers." where as it is supposed to be ".proxyuser." Even though 
> the incorrect properties will be ignored by YARN however it should be good to 
> correct the spelling mistake on these properties.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/kerberos.json 
> a8379ee 
>   
> ambari-server/src/main/resources/common-services/YARN/3.0.0.3.0/kerberos.json 
> 4cb18a9 
>   ambari-server/src/main/resources/stacks/HDP/2.2/services/YARN/kerberos.json 
> 784589c 
>   
> ambari-server/src/main/resources/stacks/HDP/2.3.ECS/services/YARN/kerberos.json
>  74b5746 
>   ambari-server/src/main/resources/stacks/HDP/2.3/services/YARN/kerberos.json 
> c20bd23 
>   ambari-server/src/main/resources/stacks/HDP/2.5/services/YARN/kerberos.json 
> 4cb18a9 
>   
> ambari-server/src/main/resources/stacks/PERF/1.0/services/YARN/kerberos.json 
> f33c07d 
>   
> ambari-server/src/test/python/stacks/2.2/configs/pig-service-check-secure.json
>  0d0c6f5 
>   
> ambari-server/src/test/resources/kerberos/test_kerberos_descriptor_2_1_3.json 
> a9e0bcd 
>   ambari-web/app/assets/data/stacks/HDP-2.1/service_components.json d853f24 
>   ambari-web/app/data/configs/wizards/secure_mapping.js 8d952e8 
> 
> Diff: https://reviews.apache.org/r/55129/diff/
> 
> 
> Testing
> ---
> 
> Existing testcases does not directly address this. So test not performed.
> 
> 
> Thanks,
> 
> Jay SenSharma
> 
>



Re: Review Request 55556: ranger_usersync should install with ranger_admin in the same host

2017-01-17 Thread alice alice

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/6/
---

(Updated 一月 18, 2017, 6:01 a.m.)


Review request for Ambari, Alejandro Fernandez, Jaimin Jetly, Jayush Luniya, 
Zhe (Joe) Wang, Richard Zang, Sumit Mohanty, Sid Wagle, and Yusaku Sako.


Bugs: AMBARI-19557
https://issues.apache.org/jira/browse/AMBARI-19557


Repository: ambari


Description
---

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_Ranger_Install_Guide/content/ch03s01.html??
The Ranger Admin and Ranger Usersync services must be installed on the same 
cluster node.
so we'd betted install ranger_admin and ranger_usersync in same cluster node in 
instaling at managing master hostcomponent


Diffs (updated)
-

  ambari-server/src/main/resources/common-services/RANGER/0.4.0/metainfo.xml 
92527c3 

Diff: https://reviews.apache.org/r/6/diff/


Testing
---

done it


Thanks,

alice alice



Re: Review Request 55556: ranger_usersync should install with ranger_admin in the same host

2017-01-17 Thread alice alice


> On 一月 17, 2017, 7:09 p.m., Alejandro Fernandez wrote:
> > ambari-web/app/models/stack_service_component.js, line 200
> > 
> >
> > The standard is to provide that information in the metainfo file for 
> > several good reasons.
> > * Support multiple stacks which may have differences in behavior
> > * Support multiple versions of the same stack which may have 
> > differences in behavior
> > * Abstract knowledge of the web-layer having to know about Hadoop
> > 
> > I think the 2nd approach is more consistent with the rest of Ambari.
> 
> Jayush Luniya wrote:
> +1 we need to do away with UI hacks
> 
> alice zhangxiaolu wrote:
> Thanks for your reply.
> But I find the fronted javascript code can not be deleted which will 
> cause the RANGER_USERSYNC still can be assigned to the other host.
> So I will keep them .
> Besides,I will add the configuration in the 2nd approach to my patch too.
> what do you think about it?
> 
> Alejandro Fernandez wrote:
> We appreciate your contribution, but we should avoid the practice of 
> hardcoding component names in the UI; that's why the metainfo.xml file exists 
> for each component and for each version.

Thanks for your reply.
Very well, you are quite right, I will apply the second method in my patch. 
  
Centainly we will consider this feature later, which can control the display of 
front-end by adding tag to metainfo.


- alice


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/6/#review161910
---


On 一月 17, 2017, 2:12 a.m., alice alice wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/6/
> ---
> 
> (Updated 一月 17, 2017, 2:12 a.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Jaimin Jetly, Jayush Luniya, 
> Zhe (Joe) Wang, Richard Zang, Sumit Mohanty, Sid Wagle, and Yusaku Sako.
> 
> 
> Bugs: AMBARI-19557
> https://issues.apache.org/jira/browse/AMBARI-19557
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_Ranger_Install_Guide/content/ch03s01.html??
> The Ranger Admin and Ranger Usersync services must be installed on the same 
> cluster node.
> so we'd betted install ranger_admin and ranger_usersync in same cluster node 
> in instaling at managing master hostcomponent
> 
> 
> Diffs
> -
> 
>   ambari-web/app/models/stack_service_component.js 17c2aa1 
> 
> Diff: https://reviews.apache.org/r/6/diff/
> 
> 
> Testing
> ---
> 
> done it
> 
> 
> Thanks,
> 
> alice alice
> 
>



Re: Review Request 55556: ranger_usersync should install with ranger_admin in the same host

2017-01-17 Thread alice alice


> On 一月 16, 2017, 7:05 p.m., Alejandro Fernandez wrote:
> > ambari-web/app/models/stack_service_component.js, line 200
> > 
> >
> > Can this come from metainfo instead of being hardcoded on the UI?
> > 
> > Please add Jaimin Jetly for input.
> 
> alice zhangxiaolu wrote:
> As we all know, there are two ways installing relative components in same 
> host;
> 
> (1)fisrt method is as above, configs relative components in 
> stack_service_component.js.
> (2)second method is in metainfo,but cannot be shown in web. The method is 
> as follows:
> 
> 
>   true
>   RANGER/RANGER_ADMIN
> 
> 
> so suggest we can select one.
> thanks for your reply.
> 
> alice zhangxiaolu wrote:
> Please ignore my above reply : )
> 
> 
> Thanks for your reply.
> As I know, there are two ways making one component install with other in 
> same host automaticlly
> 
> The first one is to code in stack_service_component.js as I did in my 
> patch.
> The second one is to add following configuration to section  RANGER_ADMIN 
> component in metainfo.xml:
>
>   true
>   RANGER/RANGER_USERSYNC
>
> 
> The advantage of firs way is that we can see the relation in web page 
> clearly  which the second one lacks

As we know,there are two ways installing components in same host.
1.one is in stack_service_component as above;
2.two is in metainfo, but cannot show in web.as follow?
3.

  true
  RANGER/RANGER_ADMIN


so in this case,I recommend that we can select first method.
thanks for your reply.


- alice


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/6/#review161773
---


On 一月 17, 2017, 2:12 a.m., alice alice wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/6/
> ---
> 
> (Updated 一月 17, 2017, 2:12 a.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Jaimin Jetly, Jayush Luniya, 
> Zhe (Joe) Wang, Richard Zang, Sumit Mohanty, Sid Wagle, and Yusaku Sako.
> 
> 
> Bugs: AMBARI-19557
> https://issues.apache.org/jira/browse/AMBARI-19557
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_Ranger_Install_Guide/content/ch03s01.html??
> The Ranger Admin and Ranger Usersync services must be installed on the same 
> cluster node.
> so we'd betted install ranger_admin and ranger_usersync in same cluster node 
> in instaling at managing master hostcomponent
> 
> 
> Diffs
> -
> 
>   ambari-web/app/models/stack_service_component.js 17c2aa1 
> 
> Diff: https://reviews.apache.org/r/6/diff/
> 
> 
> Testing
> ---
> 
> done it
> 
> 
> Thanks,
> 
> alice alice
> 
>



Review Request 55663: Add support for call context to the stack advisor

2017-01-17 Thread Sumit Mohanty

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55663/
---

Review request for Ambari, Jayush Luniya, Swapan Shridhar, and Sid Wagle.


Bugs: AMBARI-19546
https://issues.apache.org/jira/browse/AMBARI-19546


Repository: ambari


Description
---

Add support for call context to the stack advisor. This is a limited 
enhancements to differentiate between basic contenxts. Most importantly cluster 
create vs config edit vs add service and calls to get only the attributes.

Two key changes:
Differentiate between recommendComponentLayout, validateComponentLayout, 
recommendConfigurations, recommendConfigurationDependencies, and 
validateConfigurations. The key ones to differentiate are 
recommendConfigurations and recommendConfigurationDependencies. This change is 
committed already.

Second is to distinguish between, clusterCreate, addService, and 
computeAttribute. All three are recommendConfigurations calls. Why it matters? 
During clusterCreate, stack advisor is free to compute any config properties it 
can. However, during addService and computeAttributes it should use supplied 
configs and then compute only what is needed.

The patch has changes for blueprint deployments and the infra for UI to add the 
context as needed.


Diffs
-

  
ambari-server/src/main/java/org/apache/ambari/server/api/services/stackadvisor/StackAdvisorBlueprintProcessor.java
 67dfded 
  
ambari-server/src/main/java/org/apache/ambari/server/api/services/stackadvisor/StackAdvisorRequest.java
 b804c7e 
  
ambari-server/src/main/java/org/apache/ambari/server/api/services/stackadvisor/commands/StackAdvisorCommand.java
 6f612af 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/internal/StackAdvisorResourceProvider.java
 0ad9126 
  ambari-server/src/main/resources/properties.json b7e0988 
  ambari-server/src/main/resources/scripts/stack_advisor.py 56bd34a 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py 
968a94f 
  ambari-server/src/main/resources/stacks/stack_advisor.py 6b29bc3 
  
ambari-server/src/test/java/org/apache/ambari/server/controller/internal/StackAdvisorResourceProviderTest.java
 e3b89b8 
  ambari-server/src/test/python/stacks/2.0.6/common/test_stack_advisor.py 
f39703c 

Diff: https://reviews.apache.org/r/55663/diff/


Testing
---

Ran all unit tests (python and java locally)


Thanks,

Sumit Mohanty



Re: Review Request 55129: [AMBARI-19337] Ambari has some spelling mistakes in YARN proxyuser properties in many places.

2017-01-17 Thread Jay SenSharma


> On Jan. 17, 2017, 8:08 p.m., Nate Cole wrote:
> > Ping.
> 
> Sumit Mohanty wrote:
> I just committed it. Jay can you close it.

Sumit, i see 'Alejandro' has some queries related to the property change to 
existing clusters. Once that discussion is over then we can close this review.


- Jay


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55129/#review161930
---


On Jan. 3, 2017, 8:41 a.m., Jay SenSharma wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55129/
> ---
> 
> (Updated Jan. 3, 2017, 8:41 a.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Jonathan Hurley, Nate Cole, 
> and Sid Wagle.
> 
> 
> Bugs: AMBARI-19337
> https://issues.apache.org/jira/browse/AMBARI-19337
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> YARN proxyusers properties has spelling mistake. For a long time the property 
> has ".proxyusers." where as it is supposed to be ".proxyuser." Even though 
> the incorrect properties will be ignored by YARN however it should be good to 
> correct the spelling mistake on these properties.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/kerberos.json 
> a8379ee 
>   
> ambari-server/src/main/resources/common-services/YARN/3.0.0.3.0/kerberos.json 
> 4cb18a9 
>   ambari-server/src/main/resources/stacks/HDP/2.2/services/YARN/kerberos.json 
> 784589c 
>   
> ambari-server/src/main/resources/stacks/HDP/2.3.ECS/services/YARN/kerberos.json
>  74b5746 
>   ambari-server/src/main/resources/stacks/HDP/2.3/services/YARN/kerberos.json 
> c20bd23 
>   ambari-server/src/main/resources/stacks/HDP/2.5/services/YARN/kerberos.json 
> 4cb18a9 
>   
> ambari-server/src/main/resources/stacks/PERF/1.0/services/YARN/kerberos.json 
> f33c07d 
>   
> ambari-server/src/test/python/stacks/2.2/configs/pig-service-check-secure.json
>  0d0c6f5 
>   
> ambari-server/src/test/resources/kerberos/test_kerberos_descriptor_2_1_3.json 
> a9e0bcd 
>   ambari-web/app/assets/data/stacks/HDP-2.1/service_components.json d853f24 
>   ambari-web/app/data/configs/wizards/secure_mapping.js 8d952e8 
> 
> Diff: https://reviews.apache.org/r/55129/diff/
> 
> 
> Testing
> ---
> 
> Existing testcases does not directly address this. So test not performed.
> 
> 
> Thanks,
> 
> Jay SenSharma
> 
>



Re: Review Request 55647: Fix issues around modifying yarn min container size

2017-01-17 Thread Sumit Mohanty

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55647/
---

(Updated Jan. 18, 2017, 5:03 a.m.)


Review request for Ambari, Siddharth Seth and Swapan Shridhar.


Bugs: AMBARI-19578
https://issues.apache.org/jira/browse/AMBARI-19578


Repository: ambari


Description
---

Fix issues around modifying yarn min container size


Diffs
-

  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py 
f402f78 
  ambari-server/src/test/python/stacks/2.0.6/common/test_stack_advisor.py 
a9473ad 
  ambari-server/src/test/python/stacks/2.2/common/test_stack_advisor.py 8f44e16 
  ambari-server/src/test/python/stacks/2.5/common/test_stack_advisor.py d4a301c 

Diff: https://reviews.apache.org/r/55647/diff/


Testing
---

Ran all tests locally.

One unrelated failure.

--
Ran 270 tests in 6.831s

OK
--
Failed tests:
FAIL: test_upgrade_restart_eu_with_ranger (test_namenode.TestNamenode)
--
Traceback (most recent call last):
  File 
"/Users/smohanty/enlistments/asf-ambari/ambari-common/src/test/python/mock/mock.py",
 line 1199, in patched
return func(*args, **keywargs)
  File 
"/Users/smohanty/enlistments/asf-ambari/ambari-server/src/test/python/stacks/2.0.6/HDFS/test_namenode.py",
 line 1478, in test_upgrade_restart_eu_with_ranger
self.assertTrue(setup_ranger_plugin_mock.called)
AssertionError: False is not true

--
Total run:1151
Total errors:0
Total failures:1


Thanks,

Sumit Mohanty



Re: Review Request 55129: [AMBARI-19337] Ambari has some spelling mistakes in YARN proxyuser properties in many places.

2017-01-17 Thread Jay SenSharma


> On Jan. 17, 2017, 8:45 p.m., Alejandro Fernandez wrote:
> > ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/kerberos.json,
> >  line 26
> > 
> >
> > This is essentially changing the config name.
> > What should happen to existing clusters already Kerberized?
> > Should the propery be renamed?

If the property name itself is wrong in an existing cluster then i guess it 
might not be working as expected earlier as well, because the YARN will ignore 
those properties which are incorrect (non existing). So i think for the 
existing clusters it needs to be corrected.

Please correct me if above statement is incorrect.


- Jay


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55129/#review161941
---


On Jan. 3, 2017, 8:41 a.m., Jay SenSharma wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55129/
> ---
> 
> (Updated Jan. 3, 2017, 8:41 a.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Jonathan Hurley, Nate Cole, 
> and Sid Wagle.
> 
> 
> Bugs: AMBARI-19337
> https://issues.apache.org/jira/browse/AMBARI-19337
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> YARN proxyusers properties has spelling mistake. For a long time the property 
> has ".proxyusers." where as it is supposed to be ".proxyuser." Even though 
> the incorrect properties will be ignored by YARN however it should be good to 
> correct the spelling mistake on these properties.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/kerberos.json 
> a8379ee 
>   
> ambari-server/src/main/resources/common-services/YARN/3.0.0.3.0/kerberos.json 
> 4cb18a9 
>   ambari-server/src/main/resources/stacks/HDP/2.2/services/YARN/kerberos.json 
> 784589c 
>   
> ambari-server/src/main/resources/stacks/HDP/2.3.ECS/services/YARN/kerberos.json
>  74b5746 
>   ambari-server/src/main/resources/stacks/HDP/2.3/services/YARN/kerberos.json 
> c20bd23 
>   ambari-server/src/main/resources/stacks/HDP/2.5/services/YARN/kerberos.json 
> 4cb18a9 
>   
> ambari-server/src/main/resources/stacks/PERF/1.0/services/YARN/kerberos.json 
> f33c07d 
>   
> ambari-server/src/test/python/stacks/2.2/configs/pig-service-check-secure.json
>  0d0c6f5 
>   
> ambari-server/src/test/resources/kerberos/test_kerberos_descriptor_2_1_3.json 
> a9e0bcd 
>   ambari-web/app/assets/data/stacks/HDP-2.1/service_components.json d853f24 
>   ambari-web/app/data/configs/wizards/secure_mapping.js 8d952e8 
> 
> Diff: https://reviews.apache.org/r/55129/diff/
> 
> 
> Testing
> ---
> 
> Existing testcases does not directly address this. So test not performed.
> 
> 
> Thanks,
> 
> Jay SenSharma
> 
>



Re: Review Request 55556: ranger_usersync should install with ranger_admin in the same host

2017-01-17 Thread Alejandro Fernandez


> On Jan. 17, 2017, 7:09 p.m., Alejandro Fernandez wrote:
> > ambari-web/app/models/stack_service_component.js, line 200
> > 
> >
> > The standard is to provide that information in the metainfo file for 
> > several good reasons.
> > * Support multiple stacks which may have differences in behavior
> > * Support multiple versions of the same stack which may have 
> > differences in behavior
> > * Abstract knowledge of the web-layer having to know about Hadoop
> > 
> > I think the 2nd approach is more consistent with the rest of Ambari.
> 
> Jayush Luniya wrote:
> +1 we need to do away with UI hacks
> 
> alice zhangxiaolu wrote:
> Thanks for your reply.
> But I find the fronted javascript code can not be deleted which will 
> cause the RANGER_USERSYNC still can be assigned to the other host.
> So I will keep them .
> Besides,I will add the configuration in the 2nd approach to my patch too.
> what do you think about it?

We appreciate your contribution, but we should avoid the practice of hardcoding 
component names in the UI; that's why the metainfo.xml file exists for each 
component and for each version.


- Alejandro


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/6/#review161910
---


On Jan. 17, 2017, 2:12 a.m., alice alice wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/6/
> ---
> 
> (Updated Jan. 17, 2017, 2:12 a.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Jaimin Jetly, Jayush Luniya, 
> Zhe (Joe) Wang, Richard Zang, Sumit Mohanty, Sid Wagle, and Yusaku Sako.
> 
> 
> Bugs: AMBARI-19557
> https://issues.apache.org/jira/browse/AMBARI-19557
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_Ranger_Install_Guide/content/ch03s01.html??
> The Ranger Admin and Ranger Usersync services must be installed on the same 
> cluster node.
> so we'd betted install ranger_admin and ranger_usersync in same cluster node 
> in instaling at managing master hostcomponent
> 
> 
> Diffs
> -
> 
>   ambari-web/app/models/stack_service_component.js 17c2aa1 
> 
> Diff: https://reviews.apache.org/r/6/diff/
> 
> 
> Testing
> ---
> 
> done it
> 
> 
> Thanks,
> 
> alice alice
> 
>



Re: Review Request 55556: ranger_usersync should install with ranger_admin in the same host

2017-01-17 Thread alice zhangxiaolu


> On 一月 17, 2017, 7:09 p.m., Alejandro Fernandez wrote:
> > ambari-web/app/models/stack_service_component.js, line 200
> > 
> >
> > The standard is to provide that information in the metainfo file for 
> > several good reasons.
> > * Support multiple stacks which may have differences in behavior
> > * Support multiple versions of the same stack which may have 
> > differences in behavior
> > * Abstract knowledge of the web-layer having to know about Hadoop
> > 
> > I think the 2nd approach is more consistent with the rest of Ambari.
> 
> Jayush Luniya wrote:
> +1 we need to do away with UI hacks

Thanks for your reply.
But I find the fronted javascript code can not be deleted which will cause the 
RANGER_USERSYNC still can be assigned to the other host.
So I will keep them .
Besides,I will add the configuration in the 2nd approach to my patch too.
what do you think about it?


- alice


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/6/#review161910
---


On 一月 17, 2017, 2:12 a.m., alice alice wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/6/
> ---
> 
> (Updated 一月 17, 2017, 2:12 a.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Jaimin Jetly, Jayush Luniya, 
> Zhe (Joe) Wang, Richard Zang, Sumit Mohanty, Sid Wagle, and Yusaku Sako.
> 
> 
> Bugs: AMBARI-19557
> https://issues.apache.org/jira/browse/AMBARI-19557
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_Ranger_Install_Guide/content/ch03s01.html??
> The Ranger Admin and Ranger Usersync services must be installed on the same 
> cluster node.
> so we'd betted install ranger_admin and ranger_usersync in same cluster node 
> in instaling at managing master hostcomponent
> 
> 
> Diffs
> -
> 
>   ambari-web/app/models/stack_service_component.js 17c2aa1 
> 
> Diff: https://reviews.apache.org/r/6/diff/
> 
> 
> Testing
> ---
> 
> done it
> 
> 
> Thanks,
> 
> alice alice
> 
>



Re: Review Request 55651: AMS log4j rotation properties changes should be visible on ambari-upgrade

2017-01-17 Thread Sumit Mohanty

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55651/#review162011
---


Ship it!




Ship It!

- Sumit Mohanty


On Jan. 17, 2017, 11:07 p.m., Madhuvanthi Radhakrishnan wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55651/
> ---
> 
> (Updated Jan. 17, 2017, 11:07 p.m.)
> 
> 
> Review request for Ambari and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-19600
> https://issues.apache.org/jira/browse/AMBARI-19600
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> AMS log4j rotation properties changes should be visible on ambari-upgrade
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/upgrade/UpgradeCatalog250.java
>  d19db3c 
>   
> ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/configuration/ams-hbase-log4j.xml
>  ab42034 
>   
> ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/configuration/ams-log4j.xml
>  5782e7c 
>   
> ambari-server/src/test/java/org/apache/ambari/server/upgrade/UpgradeCatalog250Test.java
>  3c5b475 
> 
> Diff: https://reviews.apache.org/r/55651/diff/
> 
> 
> Testing
> ---
> 
> Unit tests
> Ambari upgrade 2.4 -> 2.5
> 
> 
> Thanks,
> 
> Madhuvanthi Radhakrishnan
> 
>



Re: Review Request 55538: AMBARI-19545: Ambari-agent - In HIVE and OOZIE stack scripts, copy JCEKS file to desired location

2017-01-17 Thread Nahappan Somasundaram

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55538/
---

(Updated Jan. 17, 2017, 5:03 p.m.)


Review request for Ambari, Andrew Onischuk, Jonathan Hurley, Nate Cole, and 
Sumit Mohanty.


Changes
---

Fixed UT failure. Added comments to security_commons function.


Bugs: AMBARI-19545
https://issues.apache.org/jira/browse/AMBARI-19545


Repository: ambari


Description
---

AMBARI-19545: Ambari-agent - In HIVE and OOZIE stack scripts, copy JCEKS file 
to desired location


Diffs (updated)
-

  
ambari-common/src/main/python/resource_management/libraries/functions/security_commons.py
 8282dc547f6bdbea3236f2dcc65e740354f41f74 
  
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py
 4ac3f8eedbdf954795417f2ba6a3406ed677fcaf 
  
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py
 82bb30179009d91a1dcc31d1c5c361ef4eea08a9 

Diff: https://reviews.apache.org/r/55538/diff/


Testing
---

** 1. Manual testing **

Deployed all the modified files to a VM and manually verified that the JCEKS 
files were generated at the location specified in the configuration, and that 
the ACLs were also applied correctly.

** 2. mvn test -Dtest=ServicePropertiesTest -DskipPythonTests **

Audit done.
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 36.153s
[INFO] Finished at: Sat Jan 14 11:59:43 PST 2017
[INFO] Final Memory: 56M/603M
[INFO] 


Thanks,

Nahappan Somasundaram



Re: Review Request 55647: Fix issues around modifying yarn min container size

2017-01-17 Thread Alejandro Fernandez

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55647/#review161999
---


Ship it!




Ship It!

- Alejandro Fernandez


On Jan. 17, 2017, 10:29 p.m., Sumit Mohanty wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55647/
> ---
> 
> (Updated Jan. 17, 2017, 10:29 p.m.)
> 
> 
> Review request for Ambari, Siddharth Seth and Swapan Shridhar.
> 
> 
> Bugs: Ambari-19338
> https://issues.apache.org/jira/browse/Ambari-19338
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Fix issues around modifying yarn min container size
> 
> 
> Diffs
> -
> 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py 
> f402f78 
>   ambari-server/src/test/python/stacks/2.0.6/common/test_stack_advisor.py 
> a9473ad 
>   ambari-server/src/test/python/stacks/2.2/common/test_stack_advisor.py 
> 8f44e16 
>   ambari-server/src/test/python/stacks/2.5/common/test_stack_advisor.py 
> d4a301c 
> 
> Diff: https://reviews.apache.org/r/55647/diff/
> 
> 
> Testing
> ---
> 
> Ran all tests locally.
> 
> One unrelated failure.
> 
> --
> Ran 270 tests in 6.831s
> 
> OK
> --
> Failed tests:
> FAIL: test_upgrade_restart_eu_with_ranger (test_namenode.TestNamenode)
> --
> Traceback (most recent call last):
>   File 
> "/Users/smohanty/enlistments/asf-ambari/ambari-common/src/test/python/mock/mock.py",
>  line 1199, in patched
> return func(*args, **keywargs)
>   File 
> "/Users/smohanty/enlistments/asf-ambari/ambari-server/src/test/python/stacks/2.0.6/HDFS/test_namenode.py",
>  line 1478, in test_upgrade_restart_eu_with_ranger
> self.assertTrue(setup_ranger_plugin_mock.called)
> AssertionError: False is not true
> 
> --
> Total run:1151
> Total errors:0
> Total failures:1
> 
> 
> Thanks,
> 
> Sumit Mohanty
> 
>



Review Request 55651: AMS log4j rotation properties changes should be visible on ambari-upgrade

2017-01-17 Thread Madhuvanthi Radhakrishnan

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55651/
---

Review request for Ambari and Sumit Mohanty.


Bugs: AMBARI-19600
https://issues.apache.org/jira/browse/AMBARI-19600


Repository: ambari


Description
---

AMS log4j rotation properties changes should be visible on ambari-upgrade


Diffs
-

  
ambari-server/src/main/java/org/apache/ambari/server/upgrade/UpgradeCatalog250.java
 d19db3c 
  
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/configuration/ams-hbase-log4j.xml
 ab42034 
  
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/configuration/ams-log4j.xml
 5782e7c 
  
ambari-server/src/test/java/org/apache/ambari/server/upgrade/UpgradeCatalog250Test.java
 3c5b475 

Diff: https://reviews.apache.org/r/55651/diff/


Testing
---

Unit tests
Ambari upgrade 2.4 -> 2.5


Thanks,

Madhuvanthi Radhakrishnan



Re: Review Request 55538: AMBARI-19545: Ambari-agent - In HIVE and OOZIE stack scripts, copy JCEKS file to desired location

2017-01-17 Thread Nahappan Somasundaram

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55538/
---

(Updated Jan. 17, 2017, 2:55 p.m.)


Review request for Ambari, Andrew Onischuk, Jonathan Hurley, Nate Cole, and 
Sumit Mohanty.


Changes
---

Refactor update_credential_provider_path() into security_common.py


Bugs: AMBARI-19545
https://issues.apache.org/jira/browse/AMBARI-19545


Repository: ambari


Description
---

AMBARI-19545: Ambari-agent - In HIVE and OOZIE stack scripts, copy JCEKS file 
to desired location


Diffs (updated)
-

  
ambari-common/src/main/python/resource_management/libraries/functions/security_commons.py
 8282dc547f6bdbea3236f2dcc65e740354f41f74 
  
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py
 4ac3f8eedbdf954795417f2ba6a3406ed677fcaf 
  
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py
 82bb30179009d91a1dcc31d1c5c361ef4eea08a9 

Diff: https://reviews.apache.org/r/55538/diff/


Testing
---

** 1. Manual testing **

Deployed all the modified files to a VM and manually verified that the JCEKS 
files were generated at the location specified in the configuration, and that 
the ACLs were also applied correctly.

** 2. mvn test -Dtest=ServicePropertiesTest -DskipPythonTests **

Audit done.
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 36.153s
[INFO] Finished at: Sat Jan 14 11:59:43 PST 2017
[INFO] Final Memory: 56M/603M
[INFO] 


Thanks,

Nahappan Somasundaram



Re: Review Request 55538: AMBARI-19545: Ambari-agent - In HIVE and OOZIE stack scripts, copy JCEKS file to desired location

2017-01-17 Thread Jonathan Hurley

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55538/#review161984
---




ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py
 (lines 54 - 80)


Can this logic be extraced out to a common location? It seems largly 
duplicated.


- Jonathan Hurley


On Jan. 17, 2017, 3:48 p.m., Nahappan Somasundaram wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55538/
> ---
> 
> (Updated Jan. 17, 2017, 3:48 p.m.)
> 
> 
> Review request for Ambari, Andrew Onischuk, Jonathan Hurley, Nate Cole, and 
> Sumit Mohanty.
> 
> 
> Bugs: AMBARI-19545
> https://issues.apache.org/jira/browse/AMBARI-19545
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> AMBARI-19545: Ambari-agent - In HIVE and OOZIE stack scripts, copy JCEKS file 
> to desired location
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py
>  4ac3f8eedbdf954795417f2ba6a3406ed677fcaf 
>   
> ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py
>  82bb30179009d91a1dcc31d1c5c361ef4eea08a9 
> 
> Diff: https://reviews.apache.org/r/55538/diff/
> 
> 
> Testing
> ---
> 
> ** 1. Manual testing **
> 
> Deployed all the modified files to a VM and manually verified that the JCEKS 
> files were generated at the location specified in the configuration, and that 
> the ACLs were also applied correctly.
> 
> ** 2. mvn test -Dtest=ServicePropertiesTest -DskipPythonTests **
> 
> Audit done.
> [INFO] 
> 
> [INFO] BUILD SUCCESS
> [INFO] 
> 
> [INFO] Total time: 36.153s
> [INFO] Finished at: Sat Jan 14 11:59:43 PST 2017
> [INFO] Final Memory: 56M/603M
> [INFO] 
> 
> 
> 
> Thanks,
> 
> Nahappan Somasundaram
> 
>



Re: Review Request 55429: Run ZK operations in logsearch internally and enable ACL security for LogSearch/Solr

2017-01-17 Thread Miklos Gergely

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55429/#review161972
---


Fix it, then Ship it!




Ship It!


ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SecurityConfig.java
 (line 160)


the name should be logsearchAuditLogFilter


- Miklos Gergely


On Jan. 17, 2017, 8:16 p.m., Oliver Szabo wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55429/
> ---
> 
> (Updated Jan. 17, 2017, 8:16 p.m.)
> 
> 
> Review request for Ambari, Miklos Gergely and Robert Nettleton.
> 
> 
> Bugs: AMBARI-19468
> https://issues.apache.org/jira/browse/AMBARI-19468
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> - added setAcl operation inside logsearch code
> - added reload collection command (on schema or solrconfig change)
> - removed logsearch solr client dependency
> - refactor some methods to handlers in collection dao
> - removed upload configurations call from ambari logsearch stack code.
> - enable ACL security for Log Search / Infra Solr
> - fixed jinja template generation in solr-client log4j config
> - added global states (audit, service and config collection)
> - added rest api filter based on global states
> - create async upload config / check znode / collection creation / reloading 
> / set acl commands
> - removed collection dao and alias dao
> - added status REST API for global states
> 
> 
> Diffs
> -
> 
>   
> ambari-common/src/main/python/resource_management/libraries/functions/solr_cloud_util.py
>  2e48c6a 
>   ambari-logsearch/ambari-logsearch-portal/pom.xml 9d17fe4 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/configsets/audit_logs/conf/managed-schema
>  4cd412b 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/common/ACLPropertiesSplitter.java
>  PRE-CREATION 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SecurityConfig.java
>  c99a738 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SolrAuditLogPropsConfig.java
>  d270b13 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SolrConfig.java
>  fb25a63 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SolrConnectionPropsConfig.java
>  82dd7df 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SolrPropsConfig.java
>  f80d6e5 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/global/SolrAuditLogsState.java
>  PRE-CREATION 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/global/SolrCollectionState.java
>  PRE-CREATION 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/global/SolrServiceLogsState.java
>  PRE-CREATION 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/global/SolrUserConfigState.java
>  PRE-CREATION 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/configurer/LogfeederFilterConfigurer.java
>  PRE-CREATION 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/configurer/SolrAuditAliasConfigurer.java
>  PRE-CREATION 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/configurer/SolrCollectionConfigurer.java
>  PRE-CREATION 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/configurer/SolrConfigurer.java
>  PRE-CREATION 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/AuditSolrDao.java
>  309687d 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/ServiceLogsSolrDao.java
>  cf61163 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/SolrAliasDao.java
>  d78ff0da 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/SolrCollectionDao.java
>  da76924 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/SolrDaoBase.java
>  39b65ae 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/SolrSchemaFieldDao.java
>  e6a562e 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/UserConfigSolrDao.java
>  106bedc 
>   
> ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/doc/DocConsta

Review Request 55647: Fix issues around modifying yarn min container size

2017-01-17 Thread Sumit Mohanty

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55647/
---

Review request for Ambari, Siddharth Seth and Swapan Shridhar.


Bugs: Ambari-19338
https://issues.apache.org/jira/browse/Ambari-19338


Repository: ambari


Description
---

Fix issues around modifying yarn min container size


Diffs
-

  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py 
f402f78 
  ambari-server/src/test/python/stacks/2.0.6/common/test_stack_advisor.py 
a9473ad 
  ambari-server/src/test/python/stacks/2.2/common/test_stack_advisor.py 8f44e16 
  ambari-server/src/test/python/stacks/2.5/common/test_stack_advisor.py d4a301c 

Diff: https://reviews.apache.org/r/55647/diff/


Testing
---

Ran all tests locally.

One unrelated failure.

--
Ran 270 tests in 6.831s

OK
--
Failed tests:
FAIL: test_upgrade_restart_eu_with_ranger (test_namenode.TestNamenode)
--
Traceback (most recent call last):
  File 
"/Users/smohanty/enlistments/asf-ambari/ambari-common/src/test/python/mock/mock.py",
 line 1199, in patched
return func(*args, **keywargs)
  File 
"/Users/smohanty/enlistments/asf-ambari/ambari-server/src/test/python/stacks/2.0.6/HDFS/test_namenode.py",
 line 1478, in test_upgrade_restart_eu_with_ranger
self.assertTrue(setup_ranger_plugin_mock.called)
AssertionError: False is not true

--
Total run:1151
Total errors:0
Total failures:1


Thanks,

Sumit Mohanty



Re: Review Request 55516: Workflow Manager View: Start record set to 1 even when there are no records

2017-01-17 Thread Sangeeta Ravindran

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55516/
---

(Updated Jan. 17, 2017, 9:45 p.m.)


Review request for Ambari, Di Li, DIPAYAN BHOWMICK, and Nitiraj Rathore.


Bugs: AMBARI-19475
https://issues.apache.org/jira/browse/AMBARI-19475


Repository: ambari


Description
---

In the Workflow Manager View, when there are no co-ordinator or bundle records, 
the dashboard message says "Showing 1 to 0 of 0 records". This is because the 
start record is set to 1 by default.

Fix is to set the start record to 0, if the total records is 0.


Diffs (updated)
-

  
contrib/views/wfmanager/src/main/resources/ui/app/routes/design/dashboardtab.js 
78bc1c9 

Diff: https://reviews.apache.org/r/55516/diff/


Testing
---

Manual testing.


Thanks,

Sangeeta Ravindran



Re: Review Request 55516: Workflow Manager View: Start record set to 1 even when there are no records

2017-01-17 Thread Sangeeta Ravindran


> On Jan. 17, 2017, 7:25 p.m., DIPAYAN BHOWMICK wrote:
> > contrib/views/wfmanager/src/main/resources/ui/app/routes/design/dashboardtab.js,
> >  line 140
> > 
> >
> > Can we conditional ternary operator as an expression and change the 
> > code like: 
> > 
> > res.start = res.total > 0 ? start : 0;
> > 
> > Looks, much cleaner to me.

Thanks Dipayan. Uploaded the patch with the suggested change.


- Sangeeta


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55516/#review161916
---


On Jan. 17, 2017, 9:45 p.m., Sangeeta Ravindran wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55516/
> ---
> 
> (Updated Jan. 17, 2017, 9:45 p.m.)
> 
> 
> Review request for Ambari, Di Li, DIPAYAN BHOWMICK, and Nitiraj Rathore.
> 
> 
> Bugs: AMBARI-19475
> https://issues.apache.org/jira/browse/AMBARI-19475
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> In the Workflow Manager View, when there are no co-ordinator or bundle 
> records, the dashboard message says "Showing 1 to 0 of 0 records". This is 
> because the start record is set to 1 by default.
> 
> Fix is to set the start record to 0, if the total records is 0.
> 
> 
> Diffs
> -
> 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/routes/design/dashboardtab.js
>  78bc1c9 
> 
> Diff: https://reviews.apache.org/r/55516/diff/
> 
> 
> Testing
> ---
> 
> Manual testing.
> 
> 
> Thanks,
> 
> Sangeeta Ravindran
> 
>



Re: Review Request 53686: Stage and Request status should be persisted in the database

2017-01-17 Thread Jaimin Jetly


> On Dec. 15, 2016, 3:40 p.m., Nate Cole wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/actionmanager/ActionScheduler.java,
> >  line 186
> > 
> >
> > What I meant was this isn't a typically-named java variable.  Just use 
> > something like "taskStatusLoaded", and make the field private.
> 
> Jaimin Jetly wrote:
> ok. I will address this in next revision of the patch.

This has been addressed in new revision of the patch.


> On Dec. 15, 2016, 3:40 p.m., Nate Cole wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/events/TaskEvent.java, 
> > line 34
> > 
> >
> > make private
> 
> Jaimin Jetly wrote:
> I will address this in next revision of the patch.

This has been addressed in new revision of the patch.


> On Dec. 15, 2016, 3:40 p.m., Nate Cole wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/events/TaskEvent.java, 
> > lines 46-48
> > 
> >
> > javadoc
> 
> Jaimin Jetly wrote:
> I will address this in next revision of the patch.

This has been addressed in new revision of the patch.


> On Dec. 15, 2016, 3:40 p.m., Nate Cole wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/events/listeners/tasks/TaskStatusListener.java,
> >  lines 616-620
> > 
> >
> > This enum probably shouldn't be defined here since it's use is mostly 
> > by CalculatedStatus
> 
> Jaimin Jetly wrote:
> I will address this in next revision of the patch.

This has been addressed in new revision of the patch.


> On Dec. 15, 2016, 3:40 p.m., Nate Cole wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/orm/dao/HostRoleCommandDAO.java,
> >  lines 658-665
> > 
> >
> > method is nearly identical to merge() - could just use a boolean 
> > overload:  merge(HRCE, boolean)
> 
> Jaimin Jetly wrote:
> well I did not want to change the signature of merge() method but I see 
> your point about code duplicacy. 
> I will make necessary changes in next revision of the patch so that 
> merge(HostRoleCommandEntity entity) calls 
> mergeWithoutPublishEvent(HostRoleCommandEntity entity) to get the work done 
> rather than doing almost same work plus one extra line of code

This has been addressed in new revision of the patch.


- Jaimin


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53686/#review159228
---


On Jan. 17, 2017, 9:43 p.m., Jaimin Jetly wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/53686/
> ---
> 
> (Updated Jan. 17, 2017, 9:43 p.m.)
> 
> 
> Review request for Ambari, Jonathan Hurley, Nate Cole, Sumit Mohanty, and Sid 
> Wagle.
> 
> 
> Bugs: AMBARI-18868
> https://issues.apache.org/jira/browse/AMBARI-18868
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Stage and Request status should be persisted in the database.
> 
> upgrading to ambari-3.0.0 should add status for all present stages and 
> request for the cluster.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/actionmanager/ActionDBAccessorImpl.java
>  7837a7b 
>   
> ambari-server/src/main/java/org/apache/ambari/server/actionmanager/ActionScheduler.java
>  dabcb98 
>   
> ambari-server/src/main/java/org/apache/ambari/server/actionmanager/HostRoleStatus.java
>  3656bfe 
>   
> ambari-server/src/main/java/org/apache/ambari/server/actionmanager/Request.java
>  31e11c1 
>   
> ambari-server/src/main/java/org/apache/ambari/server/actionmanager/Stage.java 
> 4a05b32 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/internal/CalculatedStatus.java
>  3c415df 
>   
> ambari-server/src/main/java/org/apache/ambari/server/events/TaskCreateEvent.java
>  PRE-CREATION 
>   ambari-server/src/main/java/org/apache/ambari/server/events/TaskEvent.java 
> PRE-CREATION 
>   
> ambari-server/src/main/java/org/apache/ambari/server/events/TaskUpdateEvent.java
>  PRE-CREATION 
>   
> ambari-server/src/main/java/org/apache/ambari/server/events/listeners/tasks/TaskStatusListener.java
>  PRE-CREATION 
>   
> ambari-server/src/main/java/org/apache/ambari/server/events/publishers/TaskEventPublisher.java
>  PRE-CREATION 
>   
> ambari-server/src/main/java/org/apache/ambari/server/orm/dao/HostRoleCommandDAO.java
>  02c4091 
>   
> ambari-server/src/main/java/org/apache/ambari/server/orm/dao/RequestDAO.java 
> 1c4d0a3 
>   ambari-

Re: Review Request 53686: Stage and Request status should be persisted in the database

2017-01-17 Thread Jaimin Jetly

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53686/
---

(Updated Jan. 17, 2017, 9:43 p.m.)


Review request for Ambari, Jonathan Hurley, Nate Cole, Sumit Mohanty, and Sid 
Wagle.


Bugs: AMBARI-18868
https://issues.apache.org/jira/browse/AMBARI-18868


Repository: ambari


Description
---

Stage and Request status should be persisted in the database.

upgrading to ambari-3.0.0 should add status for all present stages and request 
for the cluster.


Diffs (updated)
-

  
ambari-server/src/main/java/org/apache/ambari/server/actionmanager/ActionDBAccessorImpl.java
 7837a7b 
  
ambari-server/src/main/java/org/apache/ambari/server/actionmanager/ActionScheduler.java
 dabcb98 
  
ambari-server/src/main/java/org/apache/ambari/server/actionmanager/HostRoleStatus.java
 3656bfe 
  
ambari-server/src/main/java/org/apache/ambari/server/actionmanager/Request.java 
31e11c1 
  ambari-server/src/main/java/org/apache/ambari/server/actionmanager/Stage.java 
4a05b32 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/internal/CalculatedStatus.java
 3c415df 
  
ambari-server/src/main/java/org/apache/ambari/server/events/TaskCreateEvent.java
 PRE-CREATION 
  ambari-server/src/main/java/org/apache/ambari/server/events/TaskEvent.java 
PRE-CREATION 
  
ambari-server/src/main/java/org/apache/ambari/server/events/TaskUpdateEvent.java
 PRE-CREATION 
  
ambari-server/src/main/java/org/apache/ambari/server/events/listeners/tasks/TaskStatusListener.java
 PRE-CREATION 
  
ambari-server/src/main/java/org/apache/ambari/server/events/publishers/TaskEventPublisher.java
 PRE-CREATION 
  
ambari-server/src/main/java/org/apache/ambari/server/orm/dao/HostRoleCommandDAO.java
 02c4091 
  ambari-server/src/main/java/org/apache/ambari/server/orm/dao/RequestDAO.java 
1c4d0a3 
  ambari-server/src/main/java/org/apache/ambari/server/orm/dao/StageDAO.java 
d2f899f 
  
ambari-server/src/main/java/org/apache/ambari/server/orm/entities/HostRoleCommandEntity.java
 74271b9 
  
ambari-server/src/main/java/org/apache/ambari/server/orm/entities/RequestEntity.java
 7944d21 
  
ambari-server/src/main/java/org/apache/ambari/server/orm/entities/StageEntity.java
 f9c8810 
  
ambari-server/src/main/java/org/apache/ambari/server/orm/entities/StageEntityPK.java
 9ca0470 
  
ambari-server/src/main/java/org/apache/ambari/server/upgrade/UpgradeCatalog300.java
 4f90ef3 
  ambari-server/src/main/resources/Ambari-DDL-Derby-CREATE.sql b79c945 
  ambari-server/src/main/resources/Ambari-DDL-MySQL-CREATE.sql 1c502bc 
  ambari-server/src/main/resources/Ambari-DDL-Oracle-CREATE.sql c6d4ad0 
  ambari-server/src/main/resources/Ambari-DDL-Postgres-CREATE.sql 1be87bb 
  ambari-server/src/main/resources/Ambari-DDL-SQLAnywhere-CREATE.sql abe48e8 
  ambari-server/src/main/resources/Ambari-DDL-SQLServer-CREATE.sql 169a464 
  
ambari-server/src/test/java/org/apache/ambari/server/actionmanager/TestActionDBAccessorImpl.java
 1ca777d 
  
ambari-server/src/test/java/org/apache/ambari/server/actionmanager/TestActionScheduler.java
 6cc511e 
  
ambari-server/src/test/java/org/apache/ambari/server/controller/internal/UpgradeResourceProviderTest.java
 a702e6f 
  
ambari-server/src/test/java/org/apache/ambari/server/controller/internal/UpgradeSummaryResourceProviderTest.java
 e398a54 
  
ambari-server/src/test/java/org/apache/ambari/server/events/listeners/tasks/TaskStatusListenerTest.java
 PRE-CREATION 
  
ambari-server/src/test/java/org/apache/ambari/server/orm/dao/UpgradeDAOTest.java
 ae85241 
  
ambari-server/src/test/java/org/apache/ambari/server/state/services/RetryUpgradeActionServiceTest.java
 7dd9932 
  
ambari-server/src/test/java/org/apache/ambari/server/upgrade/UpgradeCatalog300Test.java
 d7979e8 

Diff: https://reviews.apache.org/r/53686/diff/


Testing
---

Verified manually on a cluster by making api requests and upgrading ambari.
Add unit tests.
Verified that the patch does not break any existing unit tests on dev box. 
Jenkins job overall unit test result pending..
Verified on 1000 node cluster that the patch does not regress big operations. 
Executed Stop Services and Start Services API call which gernerated around 9000 
tasks and compared  request completion time for these operations. There was a 
minor performance gain with the patch. As part of 
https://issues.apache.org/jira/browse/AMBARI-18889, I will look if we can use 
the request status and stage status to further enhance performance.


Thanks,

Jaimin Jetly



Re: Review Request 55643: Blueprint installation should accept quick link profile

2017-01-17 Thread Balázs Bence Sári

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55643/
---

(Updated Jan. 17, 2017, 9:30 p.m.)


Review request for Ambari, Attila Doroszlai, Laszlo Puskas, Oliver Szabo, 
Robert Nettleton, Sandor Magyari, Sumit Mohanty, and Sebastian Toader.


Bugs: AMBARI-19597
https://issues.apache.org/jira/browse/AMBARI-19597


Repository: ambari


Description
---

Specifying the quick links profile should be supported in blueprint based 
cluster installation. First implementation will address the possibility of 
adding the profile to the cluster creation template.


Diffs
-

  
ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariManagementControllerImpl.java
 5e8c803 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/ControllerModule.java
 b7c9e85 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/internal/ClusterResourceProvider.java
 cb30f2d 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/internal/ProvisionClusterRequest.java
 a35da86 
  
ambari-server/src/main/java/org/apache/ambari/server/state/quicklinksprofile/AcceptAllFilter.java
 d784a22 
  
ambari-server/src/main/java/org/apache/ambari/server/state/quicklinksprofile/Component.java
 a1267df 
  
ambari-server/src/main/java/org/apache/ambari/server/state/quicklinksprofile/Filter.java
 c551830 
  
ambari-server/src/main/java/org/apache/ambari/server/state/quicklinksprofile/QuickLinksProfile.java
 c9ac6b4 
  
ambari-server/src/main/java/org/apache/ambari/server/state/quicklinksprofile/QuickLinksProfileBuilder.java
 PRE-CREATION 
  
ambari-server/src/main/java/org/apache/ambari/server/state/quicklinksprofile/QuickLinksProfileEvaluationException.java
 26819e1 
  
ambari-server/src/main/java/org/apache/ambari/server/state/quicklinksprofile/QuickLinksProfileParser.java
 a3ae677 
  
ambari-server/src/main/java/org/apache/ambari/server/state/quicklinksprofile/Service.java
 7724852 
  
ambari-server/src/main/java/org/apache/ambari/server/topology/TopologyManager.java
 7db07a0 
  
ambari-server/src/main/java/org/apache/ambari/server/utils/DefaultTimeSource.java
 PRE-CREATION 
  ambari-server/src/main/java/org/apache/ambari/server/utils/TimeSource.java 
PRE-CREATION 
  
ambari-server/src/test/java/org/apache/ambari/server/agent/AgentResourceTest.java
 17b1e27 
  
ambari-server/src/test/java/org/apache/ambari/server/controller/internal/ProvisionClusterRequestTest.java
 2cf478a 
  
ambari-server/src/test/java/org/apache/ambari/server/controller/internal/QuickLinkArtifactResourceProviderTest.java
 8c723c9 
  
ambari-server/src/test/java/org/apache/ambari/server/state/quicklinksprofile/QuickLinksProfileBuilderTest.java
 PRE-CREATION 
  
ambari-server/src/test/java/org/apache/ambari/server/topology/TopologyManagerTest.java
 7e6e5a3 
  
ambari-server/src/test/java/org/apache/ambari/server/utils/StageUtilsTest.java 
5c77831 

Diff: https://reviews.apache.org/r/55643/diff/


Testing
---

- Wrote new unit tests
- Run the unit test suite for ambari-server. No failures.
- Covered the following cases by manual testing:
   -- Installing a cluster via blueprint, quick links profile in the cluster 
creation template, profile saved the first time
   -- Installing a cluster via blueprint, quick links profile in the cluster 
creation template, there was an existing quick links profile which was 
overwritten during cluster installation
   -- Installing a cluster via blueprint, no quick links profile in the cluster 
creation template


Thanks,

Balázs Bence Sári



Review Request 55643: Blueprint installation should accept quick link profile

2017-01-17 Thread Balázs Bence Sári

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55643/
---

Review request for Ambari, Attila Doroszlai, Laszlo Puskas, Oliver Szabo, 
Robert Nettleton, Sandor Magyari, Sumit Mohanty, and Sebastian Toader.


Repository: ambari


Description
---

Specifying the quick links profile should be supported in blueprint based 
cluster installation. First implementation will address the possibility of 
adding the profile to the cluster creation template.


Diffs
-

  
ambari-server/src/main/java/org/apache/ambari/server/controller/AmbariManagementControllerImpl.java
 5e8c803 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/ControllerModule.java
 b7c9e85 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/internal/ClusterResourceProvider.java
 cb30f2d 
  
ambari-server/src/main/java/org/apache/ambari/server/controller/internal/ProvisionClusterRequest.java
 a35da86 
  
ambari-server/src/main/java/org/apache/ambari/server/state/quicklinksprofile/AcceptAllFilter.java
 d784a22 
  
ambari-server/src/main/java/org/apache/ambari/server/state/quicklinksprofile/Component.java
 a1267df 
  
ambari-server/src/main/java/org/apache/ambari/server/state/quicklinksprofile/Filter.java
 c551830 
  
ambari-server/src/main/java/org/apache/ambari/server/state/quicklinksprofile/QuickLinksProfile.java
 c9ac6b4 
  
ambari-server/src/main/java/org/apache/ambari/server/state/quicklinksprofile/QuickLinksProfileBuilder.java
 PRE-CREATION 
  
ambari-server/src/main/java/org/apache/ambari/server/state/quicklinksprofile/QuickLinksProfileEvaluationException.java
 26819e1 
  
ambari-server/src/main/java/org/apache/ambari/server/state/quicklinksprofile/QuickLinksProfileParser.java
 a3ae677 
  
ambari-server/src/main/java/org/apache/ambari/server/state/quicklinksprofile/Service.java
 7724852 
  
ambari-server/src/main/java/org/apache/ambari/server/topology/TopologyManager.java
 7db07a0 
  
ambari-server/src/main/java/org/apache/ambari/server/utils/DefaultTimeSource.java
 PRE-CREATION 
  ambari-server/src/main/java/org/apache/ambari/server/utils/TimeSource.java 
PRE-CREATION 
  
ambari-server/src/test/java/org/apache/ambari/server/agent/AgentResourceTest.java
 17b1e27 
  
ambari-server/src/test/java/org/apache/ambari/server/controller/internal/ProvisionClusterRequestTest.java
 2cf478a 
  
ambari-server/src/test/java/org/apache/ambari/server/controller/internal/QuickLinkArtifactResourceProviderTest.java
 8c723c9 
  
ambari-server/src/test/java/org/apache/ambari/server/state/quicklinksprofile/QuickLinksProfileBuilderTest.java
 PRE-CREATION 
  
ambari-server/src/test/java/org/apache/ambari/server/topology/TopologyManagerTest.java
 7e6e5a3 
  
ambari-server/src/test/java/org/apache/ambari/server/utils/StageUtilsTest.java 
5c77831 

Diff: https://reviews.apache.org/r/55643/diff/


Testing
---

- Wrote new unit tests
- Run the unit test suite for ambari-server. No failures.
- Covered the following cases by manual testing:
   -- Installing a cluster via blueprint, quick links profile in the cluster 
creation template, profile saved the first time
   -- Installing a cluster via blueprint, quick links profile in the cluster 
creation template, there was an existing quick links profile which was 
overwritten during cluster installation
   -- Installing a cluster via blueprint, no quick links profile in the cluster 
creation template


Thanks,

Balázs Bence Sári



Re: Review Request 55556: ranger_usersync should install with ranger_admin in the same host

2017-01-17 Thread Jayush Luniya


> On Jan. 17, 2017, 7:09 p.m., Alejandro Fernandez wrote:
> > ambari-web/app/models/stack_service_component.js, line 200
> > 
> >
> > The standard is to provide that information in the metainfo file for 
> > several good reasons.
> > * Support multiple stacks which may have differences in behavior
> > * Support multiple versions of the same stack which may have 
> > differences in behavior
> > * Abstract knowledge of the web-layer having to know about Hadoop
> > 
> > I think the 2nd approach is more consistent with the rest of Ambari.

+1 we need to do away with UI hacks


- Jayush


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/6/#review161910
---


On Jan. 17, 2017, 2:12 a.m., alice alice wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/6/
> ---
> 
> (Updated Jan. 17, 2017, 2:12 a.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Jaimin Jetly, Jayush Luniya, 
> Zhe (Joe) Wang, Richard Zang, Sumit Mohanty, Sid Wagle, and Yusaku Sako.
> 
> 
> Bugs: AMBARI-19557
> https://issues.apache.org/jira/browse/AMBARI-19557
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_Ranger_Install_Guide/content/ch03s01.html??
> The Ranger Admin and Ranger Usersync services must be installed on the same 
> cluster node.
> so we'd betted install ranger_admin and ranger_usersync in same cluster node 
> in instaling at managing master hostcomponent
> 
> 
> Diffs
> -
> 
>   ambari-web/app/models/stack_service_component.js 17c2aa1 
> 
> Diff: https://reviews.apache.org/r/6/diff/
> 
> 
> Testing
> ---
> 
> done it
> 
> 
> Thanks,
> 
> alice alice
> 
>



Re: Review Request 55642: AMBARI-19598. (1). Set the calculated value for config 'num_llap_nodes', and (2). Remove 'Tech Preview' string for HSI from HDP 2.6 onwards.

2017-01-17 Thread Alejandro Fernandez

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55642/#review161948
---


Ship it!




Ship It!

- Alejandro Fernandez


On Jan. 17, 2017, 9:04 p.m., Swapan Shridhar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55642/
> ---
> 
> (Updated Jan. 17, 2017, 9:04 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Sumit Mohanty, and Siddharth 
> Seth.
> 
> 
> Bugs: AMBARI-19598
> https://issues.apache.org/jira/browse/AMBARI-19598
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> (1). Set the calculated value for config 'num_llap_nodes', and 
> (2). Remove 'Tech Preview' string for HSI from HDP 2.6 onwards.
> 
> 
> Diffs
> -
> 
>   ambari-server/src/main/resources/stacks/HDP/2.5/services/stack_advisor.py 
> 2ad35a2 
>   
> ambari-server/src/main/resources/stacks/HDP/2.6/services/HIVE/configuration/hive-interactive-env.xml
>  a8c2415 
>   ambari-server/src/test/python/stacks/2.5/common/test_stack_advisor.py 
> d4a301c 
> 
> Diff: https://reviews.apache.org/r/55642/diff/
> 
> 
> Testing
> ---
> 
> Yes. 
> 
> - Python UTs updated.
> - Tested on cluster.
> 
> 
> Thanks,
> 
> Swapan Shridhar
> 
>



Re: Review Request 55642: AMBARI-19598. (1). Set the calculated value for config 'num_llap_nodes', and (2). Remove 'Tech Preview' string for HSI from HDP 2.6 onwards.

2017-01-17 Thread Swapan Shridhar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55642/
---

(Updated Jan. 17, 2017, 9:04 p.m.)


Review request for Ambari, Alejandro Fernandez, Sumit Mohanty, and Siddharth 
Seth.


Changes
---

Updated, the patch with correct patch name.


Bugs: AMBARI-19598
https://issues.apache.org/jira/browse/AMBARI-19598


Repository: ambari


Description
---

(1). Set the calculated value for config 'num_llap_nodes', and 
(2). Remove 'Tech Preview' string for HSI from HDP 2.6 onwards.


Diffs (updated)
-

  ambari-server/src/main/resources/stacks/HDP/2.5/services/stack_advisor.py 
2ad35a2 
  
ambari-server/src/main/resources/stacks/HDP/2.6/services/HIVE/configuration/hive-interactive-env.xml
 a8c2415 
  ambari-server/src/test/python/stacks/2.5/common/test_stack_advisor.py d4a301c 

Diff: https://reviews.apache.org/r/55642/diff/


Testing
---

Yes. 

- Python UTs updated.
- Tested on cluster.


Thanks,

Swapan Shridhar



Re: Review Request 55642: AMBARI-19598. (1). Set the calculated value for config 'num_llap_nodes', and (2). Remove 'Tech Preview' string for HSI from HDP 2.6 onwards.

2017-01-17 Thread Sumit Mohanty

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55642/#review161946
---


Ship it!




Ship It!

- Sumit Mohanty


On Jan. 17, 2017, 8:58 p.m., Swapan Shridhar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55642/
> ---
> 
> (Updated Jan. 17, 2017, 8:58 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Sumit Mohanty, and Siddharth 
> Seth.
> 
> 
> Bugs: AMBARI-19598
> https://issues.apache.org/jira/browse/AMBARI-19598
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> (1). Set the calculated value for config 'num_llap_nodes', and 
> (2). Remove 'Tech Preview' string for HSI from HDP 2.6 onwards.
> 
> 
> Diffs
> -
> 
>   ambari-server/src/main/resources/stacks/HDP/2.5/services/stack_advisor.py 
> 2ad35a2 
>   
> ambari-server/src/main/resources/stacks/HDP/2.6/services/HIVE/configuration/hive-interactive-env.xml
>  a8c2415 
>   ambari-server/src/test/python/stacks/2.5/common/test_stack_advisor.py 
> d4a301c 
> 
> Diff: https://reviews.apache.org/r/55642/diff/
> 
> 
> Testing
> ---
> 
> Yes. 
> 
> - Python UTs updated.
> - Tested on cluster.
> 
> 
> Thanks,
> 
> Swapan Shridhar
> 
>



Review Request 55642: AMBARI-19598. (1). Set the calculated value for config 'num_llap_nodes', and (2). Remove 'Tech Preview' string for HSI from HDP 2.6 onwards.

2017-01-17 Thread Swapan Shridhar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55642/
---

Review request for Ambari, Alejandro Fernandez, Sumit Mohanty, and Siddharth 
Seth.


Bugs: AMBARI-19598
https://issues.apache.org/jira/browse/AMBARI-19598


Repository: ambari


Description
---

(1). Set the calculated value for config 'num_llap_nodes', and 
(2). Remove 'Tech Preview' string for HSI from HDP 2.6 onwards.


Diffs
-

  ambari-server/src/main/resources/stacks/HDP/2.5/services/stack_advisor.py 
2ad35a2 
  
ambari-server/src/main/resources/stacks/HDP/2.6/services/HIVE/configuration/hive-interactive-env.xml
 a8c2415 
  ambari-server/src/test/python/stacks/2.5/common/test_stack_advisor.py d4a301c 

Diff: https://reviews.apache.org/r/55642/diff/


Testing
---

Yes. 

- Python UTs updated.
- Tested on cluster.


Thanks,

Swapan Shridhar



Re: Review Request 55538: AMBARI-19545: Ambari-agent - In HIVE and OOZIE stack scripts, copy JCEKS file to desired location

2017-01-17 Thread Nahappan Somasundaram

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55538/
---

(Updated Jan. 17, 2017, 12:48 p.m.)


Review request for Ambari, Andrew Onischuk, Jonathan Hurley, Nate Cole, and 
Sumit Mohanty.


Changes
---

Indentation of return params['configurations'][config_type] should be outside 
the **if** statement. This caused UTs to break and default installation of HIVE 
to fail.


Bugs: AMBARI-19545
https://issues.apache.org/jira/browse/AMBARI-19545


Repository: ambari


Description
---

AMBARI-19545: Ambari-agent - In HIVE and OOZIE stack scripts, copy JCEKS file 
to desired location


Diffs (updated)
-

  
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py
 4ac3f8eedbdf954795417f2ba6a3406ed677fcaf 
  
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py
 82bb30179009d91a1dcc31d1c5c361ef4eea08a9 

Diff: https://reviews.apache.org/r/55538/diff/


Testing
---

** 1. Manual testing **

Deployed all the modified files to a VM and manually verified that the JCEKS 
files were generated at the location specified in the configuration, and that 
the ACLs were also applied correctly.

** 2. mvn test -Dtest=ServicePropertiesTest -DskipPythonTests **

Audit done.
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 36.153s
[INFO] Finished at: Sat Jan 14 11:59:43 PST 2017
[INFO] Final Memory: 56M/603M
[INFO] 


Thanks,

Nahappan Somasundaram



Re: Review Request 55590: Add common log rotation settings to HDFS, Zookeeper configs - addendum

2017-01-17 Thread Sumit Mohanty

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55590/#review161943
---


Ship it!




Ship It!

- Sumit Mohanty


On Jan. 16, 2017, 8:19 p.m., Madhuvanthi Radhakrishnan wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55590/
> ---
> 
> (Updated Jan. 16, 2017, 8:19 p.m.)
> 
> 
> Review request for Ambari and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-18814 and AMBARI-19274
> https://issues.apache.org/jira/browse/AMBARI-18814
> https://issues.apache.org/jira/browse/AMBARI-19274
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Default value for hdfs maxbackupindex was originally 10, 
> https://reviews.apache.org/r/54760/  changed it to 20.
> Default value for zookeeper maxfilesize and maxbackupindex was originally 10, 
>  https://reviews.apache.org/r/54955/ changed it to 256 and 20 respectively.
> Made appropriate corrections in this patch.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/configuration/hdfs-log4j.xml
>  52f166d 
>   
> ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5/configuration/zookeeper-log4j.xml
>  3725bc0 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py
>  0f3a2c4 
>   
> ambari-server/src/main/resources/stacks/HDP/2.2/services/HDFS/configuration/hdfs-log4j.xml
>  7bdb938 
> 
> Diff: https://reviews.apache.org/r/55590/diff/
> 
> 
> Testing
> ---
> 
> Run unitTests
> 
> 
> Thanks,
> 
> Madhuvanthi Radhakrishnan
> 
>



Re: Review Request 55129: [AMBARI-19337] Ambari has some spelling mistakes in YARN proxyuser properties in many places.

2017-01-17 Thread Alejandro Fernandez

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55129/#review161941
---




ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/kerberos.json 
(line 26)


This is essentially changing the config name.
What should happen to existing clusters already Kerberized?
Should the propery be renamed?


- Alejandro Fernandez


On Jan. 3, 2017, 8:41 a.m., Jay SenSharma wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55129/
> ---
> 
> (Updated Jan. 3, 2017, 8:41 a.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Jonathan Hurley, Nate Cole, 
> and Sid Wagle.
> 
> 
> Bugs: AMBARI-19337
> https://issues.apache.org/jira/browse/AMBARI-19337
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> YARN proxyusers properties has spelling mistake. For a long time the property 
> has ".proxyusers." where as it is supposed to be ".proxyuser." Even though 
> the incorrect properties will be ignored by YARN however it should be good to 
> correct the spelling mistake on these properties.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/kerberos.json 
> a8379ee 
>   
> ambari-server/src/main/resources/common-services/YARN/3.0.0.3.0/kerberos.json 
> 4cb18a9 
>   ambari-server/src/main/resources/stacks/HDP/2.2/services/YARN/kerberos.json 
> 784589c 
>   
> ambari-server/src/main/resources/stacks/HDP/2.3.ECS/services/YARN/kerberos.json
>  74b5746 
>   ambari-server/src/main/resources/stacks/HDP/2.3/services/YARN/kerberos.json 
> c20bd23 
>   ambari-server/src/main/resources/stacks/HDP/2.5/services/YARN/kerberos.json 
> 4cb18a9 
>   
> ambari-server/src/main/resources/stacks/PERF/1.0/services/YARN/kerberos.json 
> f33c07d 
>   
> ambari-server/src/test/python/stacks/2.2/configs/pig-service-check-secure.json
>  0d0c6f5 
>   
> ambari-server/src/test/resources/kerberos/test_kerberos_descriptor_2_1_3.json 
> a9e0bcd 
>   ambari-web/app/assets/data/stacks/HDP-2.1/service_components.json d853f24 
>   ambari-web/app/data/configs/wizards/secure_mapping.js 8d952e8 
> 
> Diff: https://reviews.apache.org/r/55129/diff/
> 
> 
> Testing
> ---
> 
> Existing testcases does not directly address this. So test not performed.
> 
> 
> Thanks,
> 
> Jay SenSharma
> 
>



Re: Review Request 55634: ZKFC version shows incorrect in DB tables upon downgrade

2017-01-17 Thread Jonathan Hurley


> On Jan. 17, 2017, 3:07 p.m., Jonathan Hurley wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/state/UpgradeHelper.java,
> >  lines 814-817
> > 
> >
> > Do you think it's better to simply do:
> > 
> > ```
> > if (!versionAdvertised){
> >   serviceComponentHost.setVersion(StackVersionListener.UNKNOWN_VERSION)
> > }
> > ```
> > 
> > To make this read easier? I know that this would result in more work 
> > for the DB, but it's less confusing semantically. Just a thought is all.
> 
> Nate Cole wrote:
> I thought of that, but this is working on the HostComponent directly, and 
> ideally this should happen naturally.  I was trying to isolate for when the 
> version must be UNKNOWN and couldn't get there on its own.  Can relax if you 
> think it's needed.

Nah - just took me a minute to read/comprehend it - you can leave it.


- Jonathan


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55634/#review161925
---


On Jan. 17, 2017, 3:29 p.m., Nate Cole wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55634/
> ---
> 
> (Updated Jan. 17, 2017, 3:29 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.
> 
> 
> Bugs: AMBARI-19596
> https://issues.apache.org/jira/browse/AMBARI-19596
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Steps:
> * Install ZKFC using HDP-2.3.
> * Register a version for HDP-2.6
> * Start Upgrade
> * At first chance, start Downgrade
> 
> In HDP-2.6, ZKFC is marked as {{versionAdvertised=false}}.  In HDP-2.6, 
> {{versionAdvertised=true}}.  On downgrade, that component's desired version 
> should be marked UNKNOWN with upgrade state of NONE.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/internal/UpgradeResourceProvider.java
>  6f8ebb7 
>   
> ambari-server/src/main/java/org/apache/ambari/server/events/listeners/upgrade/StackVersionListener.java
>  f5a5b0c 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/UpgradeHelper.java 
> 52bf428 
>   
> ambari-server/src/test/java/org/apache/ambari/server/controller/internal/UpgradeResourceProviderTest.java
>  a702e6f 
>   
> ambari-server/src/test/resources/stacks/HDP/2.1.1/services/STORM/metainfo.xml 
> 79a3130 
>   
> ambari-server/src/test/resources/stacks/HDP/2.2.0/services/STORM/metainfo.xml 
> PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/55634/diff/
> 
> 
> Testing
> ---
> 
> Manual.  Automated:
> 
> Tests run: 4860, Failures: 0, Errors: 0, Skipped: 38
> 
> [INFO] 
> 
> [INFO] BUILD SUCCESS
> [INFO] 
> 
> [INFO] Total time: 34:06.193s
> [INFO] Finished at: Tue Jan 17 15:10:23 EST 2017
> [INFO] Final Memory: 38M/713M
> [INFO] 
> 
> 
> 
> Thanks,
> 
> Nate Cole
> 
>



Re: Review Request 55634: ZKFC version shows incorrect in DB tables upon downgrade

2017-01-17 Thread Nate Cole

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55634/
---

(Updated Jan. 17, 2017, 3:29 p.m.)


Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.


Bugs: AMBARI-19596
https://issues.apache.org/jira/browse/AMBARI-19596


Repository: ambari


Description
---

Steps:
* Install ZKFC using HDP-2.3.
* Register a version for HDP-2.6
* Start Upgrade
* At first chance, start Downgrade

In HDP-2.6, ZKFC is marked as {{versionAdvertised=false}}.  In HDP-2.6, 
{{versionAdvertised=true}}.  On downgrade, that component's desired version 
should be marked UNKNOWN with upgrade state of NONE.


Diffs
-

  
ambari-server/src/main/java/org/apache/ambari/server/controller/internal/UpgradeResourceProvider.java
 6f8ebb7 
  
ambari-server/src/main/java/org/apache/ambari/server/events/listeners/upgrade/StackVersionListener.java
 f5a5b0c 
  ambari-server/src/main/java/org/apache/ambari/server/state/UpgradeHelper.java 
52bf428 
  
ambari-server/src/test/java/org/apache/ambari/server/controller/internal/UpgradeResourceProviderTest.java
 a702e6f 
  ambari-server/src/test/resources/stacks/HDP/2.1.1/services/STORM/metainfo.xml 
79a3130 
  ambari-server/src/test/resources/stacks/HDP/2.2.0/services/STORM/metainfo.xml 
PRE-CREATION 

Diff: https://reviews.apache.org/r/55634/diff/


Testing (updated)
---

Manual.  Automated:

Tests run: 4860, Failures: 0, Errors: 0, Skipped: 38

[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 34:06.193s
[INFO] Finished at: Tue Jan 17 15:10:23 EST 2017
[INFO] Final Memory: 38M/713M
[INFO] 


Thanks,

Nate Cole



Re: Review Request 55634: ZKFC version shows incorrect in DB tables upon downgrade

2017-01-17 Thread Nate Cole


> On Jan. 17, 2017, 3:07 p.m., Jonathan Hurley wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/state/UpgradeHelper.java,
> >  lines 791-793
> > 
> >
> > OK, this is a really odd question and I'm not going to try to sort it 
> > out in my head since you just worked in this area and probably have the 
> > answer:
> > 
> > Let's say 1.0 to 1.1 happens and a new component is added. Then you 
> > downgrade back to 1.0. Now, the component will still be passed in from the 
> > invoking method in the collection of target services/components ... but 
> > AmbariMetaInfo woudn't have any information for it in the "targetStack", 
> > right? So would this throw a NPE?
> > 
> > If I'm wrong, please drop.

According to today's code, when any of stack, stack version, service or 
component are null from AmbariMetainfo internals, some form of AmbariException 
is thrown to the caller.


> On Jan. 17, 2017, 3:07 p.m., Jonathan Hurley wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/state/UpgradeHelper.java,
> >  lines 814-817
> > 
> >
> > Do you think it's better to simply do:
> > 
> > ```
> > if (!versionAdvertised){
> >   serviceComponentHost.setVersion(StackVersionListener.UNKNOWN_VERSION)
> > }
> > ```
> > 
> > To make this read easier? I know that this would result in more work 
> > for the DB, but it's less confusing semantically. Just a thought is all.

I thought of that, but this is working on the HostComponent directly, and 
ideally this should happen naturally.  I was trying to isolate for when the 
version must be UNKNOWN and couldn't get there on its own.  Can relax if you 
think it's needed.


- Nate


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55634/#review161925
---


On Jan. 17, 2017, 2:59 p.m., Nate Cole wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55634/
> ---
> 
> (Updated Jan. 17, 2017, 2:59 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.
> 
> 
> Bugs: AMBARI-19596
> https://issues.apache.org/jira/browse/AMBARI-19596
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Steps:
> * Install ZKFC using HDP-2.3.
> * Register a version for HDP-2.6
> * Start Upgrade
> * At first chance, start Downgrade
> 
> In HDP-2.6, ZKFC is marked as {{versionAdvertised=false}}.  In HDP-2.6, 
> {{versionAdvertised=true}}.  On downgrade, that component's desired version 
> should be marked UNKNOWN with upgrade state of NONE.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/internal/UpgradeResourceProvider.java
>  6f8ebb7 
>   
> ambari-server/src/main/java/org/apache/ambari/server/events/listeners/upgrade/StackVersionListener.java
>  f5a5b0c 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/UpgradeHelper.java 
> 52bf428 
>   
> ambari-server/src/test/java/org/apache/ambari/server/controller/internal/UpgradeResourceProviderTest.java
>  a702e6f 
>   
> ambari-server/src/test/resources/stacks/HDP/2.1.1/services/STORM/metainfo.xml 
> 79a3130 
>   
> ambari-server/src/test/resources/stacks/HDP/2.2.0/services/STORM/metainfo.xml 
> PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/55634/diff/
> 
> 
> Testing
> ---
> 
> Manual.  Automated pending.
> 
> 
> Thanks,
> 
> Nate Cole
> 
>



Re: Review Request 55129: [AMBARI-19337] Ambari has some spelling mistakes in YARN proxyuser properties in many places.

2017-01-17 Thread Sumit Mohanty


> On Jan. 17, 2017, 8:08 p.m., Nate Cole wrote:
> > Ping.

I just committed it. Jay can you close it.


- Sumit


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55129/#review161930
---


On Jan. 3, 2017, 8:41 a.m., Jay SenSharma wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55129/
> ---
> 
> (Updated Jan. 3, 2017, 8:41 a.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Jonathan Hurley, Nate Cole, 
> and Sid Wagle.
> 
> 
> Bugs: AMBARI-19337
> https://issues.apache.org/jira/browse/AMBARI-19337
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> YARN proxyusers properties has spelling mistake. For a long time the property 
> has ".proxyusers." where as it is supposed to be ".proxyuser." Even though 
> the incorrect properties will be ignored by YARN however it should be good to 
> correct the spelling mistake on these properties.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/kerberos.json 
> a8379ee 
>   
> ambari-server/src/main/resources/common-services/YARN/3.0.0.3.0/kerberos.json 
> 4cb18a9 
>   ambari-server/src/main/resources/stacks/HDP/2.2/services/YARN/kerberos.json 
> 784589c 
>   
> ambari-server/src/main/resources/stacks/HDP/2.3.ECS/services/YARN/kerberos.json
>  74b5746 
>   ambari-server/src/main/resources/stacks/HDP/2.3/services/YARN/kerberos.json 
> c20bd23 
>   ambari-server/src/main/resources/stacks/HDP/2.5/services/YARN/kerberos.json 
> 4cb18a9 
>   
> ambari-server/src/main/resources/stacks/PERF/1.0/services/YARN/kerberos.json 
> f33c07d 
>   
> ambari-server/src/test/python/stacks/2.2/configs/pig-service-check-secure.json
>  0d0c6f5 
>   
> ambari-server/src/test/resources/kerberos/test_kerberos_descriptor_2_1_3.json 
> a9e0bcd 
>   ambari-web/app/assets/data/stacks/HDP-2.1/service_components.json d853f24 
>   ambari-web/app/data/configs/wizards/secure_mapping.js 8d952e8 
> 
> Diff: https://reviews.apache.org/r/55129/diff/
> 
> 
> Testing
> ---
> 
> Existing testcases does not directly address this. So test not performed.
> 
> 
> Thanks,
> 
> Jay SenSharma
> 
>



Re: Review Request 55597: Add upgrade logic for the heap dump control option added in HDP 2.6 stack.

2017-01-17 Thread Robert Levas


> On Jan. 17, 2017, 9:47 a.m., Robert Levas wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java,
> >  line 479
> > 
> >
> > `contains` seems to be a little relaxed here. What if we are inserting 
> > FOO into a value where FOOBAR exists.  FOO will not be inserted.
> 
> Jonathan Hurley wrote:
> Relaxed, yes, but I think that's why this never made it into Ambari in 
> previous versions. Because questions like this exposed a ton of weird edge 
> cases. And then we end up without the ability to insert content at all.
> 
> This was meant as a first attempt to get the new properties in - I can 
> open another Jira for tracking this since I don't see a good solution 
> currently. Would that be sufficient?
> 
> Jonathan Hurley wrote:
> Do you think a "beginsWith" and "endsWith" would be sufficient here? 
> Since we're currently only prepending/appending, would that make sense?
> 
> Robert Levas wrote:
> I suppopse this can be dropped as long as it is known.  But maybe a 
> regular expression match to create a search for "whole words" - ala 
> IntelliJ's "Whole words only" search feature.
> 
> Example:
> ```
> \bFOO\b
> ```
> 
> Jonathan Hurley wrote:
> I thought of that, but consider this exact case:
> 
> foo
> changes to
> foo{{heap_options}}
> 
> Now, {{heap_options}} would get re-appended since the whole word match 
> won't work. I don't fully understand why this property was created without a 
> space, but the original committer went to great lengths to add spaces in the 
> Python code whenever they use it. It would have made more sense to me to 
> create it as "foo {{heap_opts}}" .. but alas, it is what it is.
> 
> With that said, yes, I can open a Jira to investigate better ways to 
> match to make this idempotent. Right now, it's matching on `contains()` which 
> should be sufficient for most property inserts.

Seems like a no-win secenario... I will drop this but maybe the future will 
yield a new replace mechanism to handle the case you specified above.. which is 
different than thia insert case


- Robert


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55597/#review161868
---


On Jan. 16, 2017, 9:54 p.m., Jonathan Hurley wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55597/
> ---
> 
> (Updated Jan. 16, 2017, 9:54 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko, Nate Cole, and Robert Levas.
> 
> 
> Bugs: AMBARI-19574
> https://issues.apache.org/jira/browse/AMBARI-19574
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> There's a fuller description in the Jira issue, but just to sum up for easy 
> of reading:
> 
> - Hive added some properties in HDP 2.6
> - To upgrade these properties, existing content would need to be modified. 
> Unfortunately, find/replace isn't an option here
> - I created a very simple  directive to prepend/append properties
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java
>  97280ee 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigUpgradeChangeDefinition.java
>  5428ea7 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigureTask.java
>  d7bb338 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml 
> 40052d8 
>   
> ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.6.xml
>  09608a0 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.6.xml 
> 949a174 
>   ambari-server/src/main/resources/upgrade-config.xsd e274451 
>   
> ambari-server/src/test/java/org/apache/ambari/server/serveraction/upgrades/ConfigureActionTest.java
>  92fa084 
> 
> Diff: https://reviews.apache.org/r/55597/diff/
> 
> 
> Testing
> ---
> 
> Tests run: 4857, Failures: 0, Errors: 0, Skipped: 38
> 
> [INFO] 
> 
> [INFO] BUILD SUCCESS
> [INFO] 
> 
> [INFO] Total time: 26:49 min
> [INFO] Finished at: 2017-01-16T20:53:37-05:00
> [INFO] Final Memory: 55M/708M
> [INFO] 
> 
> 
> 
> Thanks,
> 
> Jonathan Hurley
> 
>



Re: Review Request 55429: Run ZK operations in logsearch internally and enable ACL security for LogSearch/Solr

2017-01-17 Thread Oliver Szabo

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55429/
---

(Updated Jan. 17, 2017, 8:16 p.m.)


Review request for Ambari, Miklos Gergely and Robert Nettleton.


Changes
---

remove unused imports


Bugs: AMBARI-19468
https://issues.apache.org/jira/browse/AMBARI-19468


Repository: ambari


Description
---

- added setAcl operation inside logsearch code
- added reload collection command (on schema or solrconfig change)
- removed logsearch solr client dependency
- refactor some methods to handlers in collection dao
- removed upload configurations call from ambari logsearch stack code.
- enable ACL security for Log Search / Infra Solr
- fixed jinja template generation in solr-client log4j config
- added global states (audit, service and config collection)
- added rest api filter based on global states
- create async upload config / check znode / collection creation / reloading / 
set acl commands
- removed collection dao and alias dao
- added status REST API for global states


Diffs (updated)
-

  
ambari-common/src/main/python/resource_management/libraries/functions/solr_cloud_util.py
 2e48c6a 
  ambari-logsearch/ambari-logsearch-portal/pom.xml 9d17fe4 
  
ambari-logsearch/ambari-logsearch-portal/src/main/configsets/audit_logs/conf/managed-schema
 4cd412b 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/common/ACLPropertiesSplitter.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SecurityConfig.java
 c99a738 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SolrAuditLogPropsConfig.java
 d270b13 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SolrConfig.java
 fb25a63 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SolrConnectionPropsConfig.java
 82dd7df 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SolrPropsConfig.java
 f80d6e5 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/global/SolrAuditLogsState.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/global/SolrCollectionState.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/global/SolrServiceLogsState.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/global/SolrUserConfigState.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/configurer/LogfeederFilterConfigurer.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/configurer/SolrAuditAliasConfigurer.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/configurer/SolrCollectionConfigurer.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/configurer/SolrConfigurer.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/AuditSolrDao.java
 309687d 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/ServiceLogsSolrDao.java
 cf61163 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/SolrAliasDao.java
 d78ff0da 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/SolrCollectionDao.java
 da76924 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/SolrDaoBase.java
 39b65ae 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/SolrSchemaFieldDao.java
 e6a562e 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/UserConfigSolrDao.java
 106bedc 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/doc/DocConstants.java
 0fc9852 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/handler/ACLHandler.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/handler/CreateCollectionHandler.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/handler/ListCollectionHandler.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/handler/ReloadCollectionHandler.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/handler/SolrZkRequestHandler.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-port

Re: Review Request 55129: [AMBARI-19337] Ambari has some spelling mistakes in YARN proxyuser properties in many places.

2017-01-17 Thread Nate Cole

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55129/#review161930
---



Ping.

- Nate Cole


On Jan. 3, 2017, 3:41 a.m., Jay SenSharma wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55129/
> ---
> 
> (Updated Jan. 3, 2017, 3:41 a.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Jonathan Hurley, Nate Cole, 
> and Sid Wagle.
> 
> 
> Bugs: AMBARI-19337
> https://issues.apache.org/jira/browse/AMBARI-19337
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> YARN proxyusers properties has spelling mistake. For a long time the property 
> has ".proxyusers." where as it is supposed to be ".proxyuser." Even though 
> the incorrect properties will be ignored by YARN however it should be good to 
> correct the spelling mistake on these properties.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/kerberos.json 
> a8379ee 
>   
> ambari-server/src/main/resources/common-services/YARN/3.0.0.3.0/kerberos.json 
> 4cb18a9 
>   ambari-server/src/main/resources/stacks/HDP/2.2/services/YARN/kerberos.json 
> 784589c 
>   
> ambari-server/src/main/resources/stacks/HDP/2.3.ECS/services/YARN/kerberos.json
>  74b5746 
>   ambari-server/src/main/resources/stacks/HDP/2.3/services/YARN/kerberos.json 
> c20bd23 
>   ambari-server/src/main/resources/stacks/HDP/2.5/services/YARN/kerberos.json 
> 4cb18a9 
>   
> ambari-server/src/main/resources/stacks/PERF/1.0/services/YARN/kerberos.json 
> f33c07d 
>   
> ambari-server/src/test/python/stacks/2.2/configs/pig-service-check-secure.json
>  0d0c6f5 
>   
> ambari-server/src/test/resources/kerberos/test_kerberos_descriptor_2_1_3.json 
> a9e0bcd 
>   ambari-web/app/assets/data/stacks/HDP-2.1/service_components.json d853f24 
>   ambari-web/app/data/configs/wizards/secure_mapping.js 8d952e8 
> 
> Diff: https://reviews.apache.org/r/55129/diff/
> 
> 
> Testing
> ---
> 
> Existing testcases does not directly address this. So test not performed.
> 
> 
> Thanks,
> 
> Jay SenSharma
> 
>



Re: Review Request 55634: ZKFC version shows incorrect in DB tables upon downgrade

2017-01-17 Thread Jonathan Hurley

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55634/#review161925
---


Fix it, then Ship it!





ambari-server/src/main/java/org/apache/ambari/server/state/UpgradeHelper.java 
(lines 791 - 793)


OK, this is a really odd question and I'm not going to try to sort it out 
in my head since you just worked in this area and probably have the answer:

Let's say 1.0 to 1.1 happens and a new component is added. Then you 
downgrade back to 1.0. Now, the component will still be passed in from the 
invoking method in the collection of target services/components ... but 
AmbariMetaInfo woudn't have any information for it in the "targetStack", right? 
So would this throw a NPE?

If I'm wrong, please drop.



ambari-server/src/main/java/org/apache/ambari/server/state/UpgradeHelper.java 
(lines 814 - 817)


Do you think it's better to simply do:

```
if (!versionAdvertised){
  serviceComponentHost.setVersion(StackVersionListener.UNKNOWN_VERSION)
}
```

To make this read easier? I know that this would result in more work for 
the DB, but it's less confusing semantically. Just a thought is all.


- Jonathan Hurley


On Jan. 17, 2017, 2:59 p.m., Nate Cole wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55634/
> ---
> 
> (Updated Jan. 17, 2017, 2:59 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.
> 
> 
> Bugs: AMBARI-19596
> https://issues.apache.org/jira/browse/AMBARI-19596
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Steps:
> * Install ZKFC using HDP-2.3.
> * Register a version for HDP-2.6
> * Start Upgrade
> * At first chance, start Downgrade
> 
> In HDP-2.6, ZKFC is marked as {{versionAdvertised=false}}.  In HDP-2.6, 
> {{versionAdvertised=true}}.  On downgrade, that component's desired version 
> should be marked UNKNOWN with upgrade state of NONE.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/internal/UpgradeResourceProvider.java
>  6f8ebb7 
>   
> ambari-server/src/main/java/org/apache/ambari/server/events/listeners/upgrade/StackVersionListener.java
>  f5a5b0c 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/UpgradeHelper.java 
> 52bf428 
>   
> ambari-server/src/test/java/org/apache/ambari/server/controller/internal/UpgradeResourceProviderTest.java
>  a702e6f 
>   
> ambari-server/src/test/resources/stacks/HDP/2.1.1/services/STORM/metainfo.xml 
> 79a3130 
>   
> ambari-server/src/test/resources/stacks/HDP/2.2.0/services/STORM/metainfo.xml 
> PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/55634/diff/
> 
> 
> Testing
> ---
> 
> Manual.  Automated pending.
> 
> 
> Thanks,
> 
> Nate Cole
> 
>



Re: Review Request 55429: Run ZK operations in logsearch internally and enable ACL security for LogSearch/Solr

2017-01-17 Thread Oliver Szabo

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55429/
---

(Updated Jan. 17, 2017, 8:06 p.m.)


Review request for Ambari, Miklos Gergely and Robert Nettleton.


Changes
---

added status REST API for global states


Bugs: AMBARI-19468
https://issues.apache.org/jira/browse/AMBARI-19468


Repository: ambari


Description (updated)
---

- added setAcl operation inside logsearch code
- added reload collection command (on schema or solrconfig change)
- removed logsearch solr client dependency
- refactor some methods to handlers in collection dao
- removed upload configurations call from ambari logsearch stack code.
- enable ACL security for Log Search / Infra Solr
- fixed jinja template generation in solr-client log4j config
- added global states (audit, service and config collection)
- added rest api filter based on global states
- create async upload config / check znode / collection creation / reloading / 
set acl commands
- removed collection dao and alias dao
- added status REST API for global states


Diffs (updated)
-

  
ambari-common/src/main/python/resource_management/libraries/functions/solr_cloud_util.py
 2e48c6a 
  ambari-logsearch/ambari-logsearch-portal/pom.xml 9d17fe4 
  
ambari-logsearch/ambari-logsearch-portal/src/main/configsets/audit_logs/conf/managed-schema
 4cd412b 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/common/ACLPropertiesSplitter.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SecurityConfig.java
 c99a738 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SolrAuditLogPropsConfig.java
 d270b13 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SolrConfig.java
 fb25a63 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SolrConnectionPropsConfig.java
 82dd7df 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SolrPropsConfig.java
 f80d6e5 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/global/SolrAuditLogsState.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/global/SolrCollectionState.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/global/SolrServiceLogsState.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/global/SolrUserConfigState.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/configurer/LogfeederFilterConfigurer.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/configurer/SolrAuditAliasConfigurer.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/configurer/SolrCollectionConfigurer.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/configurer/SolrConfigurer.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/AuditSolrDao.java
 309687d 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/ServiceLogsSolrDao.java
 cf61163 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/SolrAliasDao.java
 d78ff0da 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/SolrCollectionDao.java
 da76924 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/SolrDaoBase.java
 39b65ae 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/SolrSchemaFieldDao.java
 e6a562e 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/UserConfigSolrDao.java
 106bedc 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/doc/DocConstants.java
 0fc9852 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/handler/ACLHandler.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/handler/CreateCollectionHandler.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/handler/ListCollectionHandler.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/handler/ReloadCollectionHandler.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/handler/SolrZkRequestHandler.java
 PRE-CREATION 
  
ambari-log

Re: Review Request 55634: ZKFC version shows incorrect in DB tables upon downgrade

2017-01-17 Thread Alejandro Fernandez

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55634/#review161927
---


Ship it!




Ship It!

- Alejandro Fernandez


On Jan. 17, 2017, 7:59 p.m., Nate Cole wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55634/
> ---
> 
> (Updated Jan. 17, 2017, 7:59 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.
> 
> 
> Bugs: AMBARI-19596
> https://issues.apache.org/jira/browse/AMBARI-19596
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Steps:
> * Install ZKFC using HDP-2.3.
> * Register a version for HDP-2.6
> * Start Upgrade
> * At first chance, start Downgrade
> 
> In HDP-2.6, ZKFC is marked as {{versionAdvertised=false}}.  In HDP-2.6, 
> {{versionAdvertised=true}}.  On downgrade, that component's desired version 
> should be marked UNKNOWN with upgrade state of NONE.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/internal/UpgradeResourceProvider.java
>  6f8ebb7 
>   
> ambari-server/src/main/java/org/apache/ambari/server/events/listeners/upgrade/StackVersionListener.java
>  f5a5b0c 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/UpgradeHelper.java 
> 52bf428 
>   
> ambari-server/src/test/java/org/apache/ambari/server/controller/internal/UpgradeResourceProviderTest.java
>  a702e6f 
>   
> ambari-server/src/test/resources/stacks/HDP/2.1.1/services/STORM/metainfo.xml 
> 79a3130 
>   
> ambari-server/src/test/resources/stacks/HDP/2.2.0/services/STORM/metainfo.xml 
> PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/55634/diff/
> 
> 
> Testing
> ---
> 
> Manual.  Automated pending.
> 
> 
> Thanks,
> 
> Nate Cole
> 
>



Re: Review Request 55538: AMBARI-19545: Ambari-agent - In HIVE and OOZIE stack scripts, copy JCEKS file to desired location

2017-01-17 Thread Nate Cole

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55538/#review161924
---


Fix it, then Ship it!





ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py
 (lines 53 - 61)


Looks to be largely duplicated code.  Can it be abstracted to 
security_commons.py?  I'd hate to have to remember to do fixes in several 
places.  Would be nice to have some mocked out tests too.


- Nate Cole


On Jan. 16, 2017, 1:45 p.m., Nahappan Somasundaram wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55538/
> ---
> 
> (Updated Jan. 16, 2017, 1:45 p.m.)
> 
> 
> Review request for Ambari, Andrew Onischuk, Jonathan Hurley, Nate Cole, and 
> Sumit Mohanty.
> 
> 
> Bugs: AMBARI-19545
> https://issues.apache.org/jira/browse/AMBARI-19545
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> AMBARI-19545: Ambari-agent - In HIVE and OOZIE stack scripts, copy JCEKS file 
> to desired location
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py
>  4ac3f8eedbdf954795417f2ba6a3406ed677fcaf 
>   
> ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py
>  21135ea5c65563716dc1fe5db0d533970d9fdb53 
> 
> Diff: https://reviews.apache.org/r/55538/diff/
> 
> 
> Testing
> ---
> 
> ** 1. Manual testing **
> 
> Deployed all the modified files to a VM and manually verified that the JCEKS 
> files were generated at the location specified in the configuration, and that 
> the ACLs were also applied correctly.
> 
> ** 2. mvn test -Dtest=ServicePropertiesTest -DskipPythonTests **
> 
> Audit done.
> [INFO] 
> 
> [INFO] BUILD SUCCESS
> [INFO] 
> 
> [INFO] Total time: 36.153s
> [INFO] Finished at: Sat Jan 14 11:59:43 PST 2017
> [INFO] Final Memory: 56M/603M
> [INFO] 
> 
> 
> 
> Thanks,
> 
> Nahappan Somasundaram
> 
>



Re: Review Request 55634: ZKFC version shows incorrect in DB tables upon downgrade

2017-01-17 Thread Nate Cole

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55634/
---

(Updated Jan. 17, 2017, 2:59 p.m.)


Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.


Changes
---

Somehow I clicked the discard review button and the diff went away.


Bugs: AMBARI-19596
https://issues.apache.org/jira/browse/AMBARI-19596


Repository: ambari


Description
---

Steps:
* Install ZKFC using HDP-2.3.
* Register a version for HDP-2.6
* Start Upgrade
* At first chance, start Downgrade

In HDP-2.6, ZKFC is marked as {{versionAdvertised=false}}.  In HDP-2.6, 
{{versionAdvertised=true}}.  On downgrade, that component's desired version 
should be marked UNKNOWN with upgrade state of NONE.


Diffs (updated)
-

  
ambari-server/src/main/java/org/apache/ambari/server/controller/internal/UpgradeResourceProvider.java
 6f8ebb7 
  
ambari-server/src/main/java/org/apache/ambari/server/events/listeners/upgrade/StackVersionListener.java
 f5a5b0c 
  ambari-server/src/main/java/org/apache/ambari/server/state/UpgradeHelper.java 
52bf428 
  
ambari-server/src/test/java/org/apache/ambari/server/controller/internal/UpgradeResourceProviderTest.java
 a702e6f 
  ambari-server/src/test/resources/stacks/HDP/2.1.1/services/STORM/metainfo.xml 
79a3130 
  ambari-server/src/test/resources/stacks/HDP/2.2.0/services/STORM/metainfo.xml 
PRE-CREATION 

Diff: https://reviews.apache.org/r/55634/diff/


Testing
---

Manual.  Automated pending.


Thanks,

Nate Cole



Re: Review Request 55597: Add upgrade logic for the heap dump control option added in HDP 2.6 stack.

2017-01-17 Thread Nate Cole

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55597/#review161923
---


Ship it!




Ship It!

- Nate Cole


On Jan. 16, 2017, 9:54 p.m., Jonathan Hurley wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55597/
> ---
> 
> (Updated Jan. 16, 2017, 9:54 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko, Nate Cole, and Robert Levas.
> 
> 
> Bugs: AMBARI-19574
> https://issues.apache.org/jira/browse/AMBARI-19574
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> There's a fuller description in the Jira issue, but just to sum up for easy 
> of reading:
> 
> - Hive added some properties in HDP 2.6
> - To upgrade these properties, existing content would need to be modified. 
> Unfortunately, find/replace isn't an option here
> - I created a very simple  directive to prepend/append properties
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java
>  97280ee 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigUpgradeChangeDefinition.java
>  5428ea7 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigureTask.java
>  d7bb338 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml 
> 40052d8 
>   
> ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.6.xml
>  09608a0 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.6.xml 
> 949a174 
>   ambari-server/src/main/resources/upgrade-config.xsd e274451 
>   
> ambari-server/src/test/java/org/apache/ambari/server/serveraction/upgrades/ConfigureActionTest.java
>  92fa084 
> 
> Diff: https://reviews.apache.org/r/55597/diff/
> 
> 
> Testing
> ---
> 
> Tests run: 4857, Failures: 0, Errors: 0, Skipped: 38
> 
> [INFO] 
> 
> [INFO] BUILD SUCCESS
> [INFO] 
> 
> [INFO] Total time: 26:49 min
> [INFO] Finished at: 2017-01-16T20:53:37-05:00
> [INFO] Final Memory: 55M/708M
> [INFO] 
> 
> 
> 
> Thanks,
> 
> Jonathan Hurley
> 
>



Re: Review Request 55597: Add upgrade logic for the heap dump control option added in HDP 2.6 stack.

2017-01-17 Thread Jonathan Hurley


> On Jan. 17, 2017, 9:47 a.m., Robert Levas wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java,
> >  line 479
> > 
> >
> > `contains` seems to be a little relaxed here. What if we are inserting 
> > FOO into a value where FOOBAR exists.  FOO will not be inserted.
> 
> Jonathan Hurley wrote:
> Relaxed, yes, but I think that's why this never made it into Ambari in 
> previous versions. Because questions like this exposed a ton of weird edge 
> cases. And then we end up without the ability to insert content at all.
> 
> This was meant as a first attempt to get the new properties in - I can 
> open another Jira for tracking this since I don't see a good solution 
> currently. Would that be sufficient?
> 
> Jonathan Hurley wrote:
> Do you think a "beginsWith" and "endsWith" would be sufficient here? 
> Since we're currently only prepending/appending, would that make sense?
> 
> Robert Levas wrote:
> I suppopse this can be dropped as long as it is known.  But maybe a 
> regular expression match to create a search for "whole words" - ala 
> IntelliJ's "Whole words only" search feature.
> 
> Example:
> ```
> \bFOO\b
> ```

I thought of that, but consider this exact case:

foo
changes to
foo{{heap_options}}

Now, {{heap_options}} would get re-appended since the whole word match won't 
work. I don't fully understand why this property was created without a space, 
but the original committer went to great lengths to add spaces in the Python 
code whenever they use it. It would have made more sense to me to create it as 
"foo {{heap_opts}}" .. but alas, it is what it is.

With that said, yes, I can open a Jira to investigate better ways to match to 
make this idempotent. Right now, it's matching on `contains()` which should be 
sufficient for most property inserts.


- Jonathan


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55597/#review161868
---


On Jan. 16, 2017, 9:54 p.m., Jonathan Hurley wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55597/
> ---
> 
> (Updated Jan. 16, 2017, 9:54 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko, Nate Cole, and Robert Levas.
> 
> 
> Bugs: AMBARI-19574
> https://issues.apache.org/jira/browse/AMBARI-19574
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> There's a fuller description in the Jira issue, but just to sum up for easy 
> of reading:
> 
> - Hive added some properties in HDP 2.6
> - To upgrade these properties, existing content would need to be modified. 
> Unfortunately, find/replace isn't an option here
> - I created a very simple  directive to prepend/append properties
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java
>  97280ee 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigUpgradeChangeDefinition.java
>  5428ea7 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigureTask.java
>  d7bb338 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml 
> 40052d8 
>   
> ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.6.xml
>  09608a0 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.6.xml 
> 949a174 
>   ambari-server/src/main/resources/upgrade-config.xsd e274451 
>   
> ambari-server/src/test/java/org/apache/ambari/server/serveraction/upgrades/ConfigureActionTest.java
>  92fa084 
> 
> Diff: https://reviews.apache.org/r/55597/diff/
> 
> 
> Testing
> ---
> 
> Tests run: 4857, Failures: 0, Errors: 0, Skipped: 38
> 
> [INFO] 
> 
> [INFO] BUILD SUCCESS
> [INFO] 
> 
> [INFO] Total time: 26:49 min
> [INFO] Finished at: 2017-01-16T20:53:37-05:00
> [INFO] Final Memory: 55M/708M
> [INFO] 
> 
> 
> 
> Thanks,
> 
> Jonathan Hurley
> 
>



Re: Review Request 55597: Add upgrade logic for the heap dump control option added in HDP 2.6 stack.

2017-01-17 Thread Alejandro Fernandez

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55597/#review161920
---


Ship it!




Ship It!

- Alejandro Fernandez


On Jan. 17, 2017, 2:54 a.m., Jonathan Hurley wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55597/
> ---
> 
> (Updated Jan. 17, 2017, 2:54 a.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko, Nate Cole, and Robert Levas.
> 
> 
> Bugs: AMBARI-19574
> https://issues.apache.org/jira/browse/AMBARI-19574
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> There's a fuller description in the Jira issue, but just to sum up for easy 
> of reading:
> 
> - Hive added some properties in HDP 2.6
> - To upgrade these properties, existing content would need to be modified. 
> Unfortunately, find/replace isn't an option here
> - I created a very simple  directive to prepend/append properties
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java
>  97280ee 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigUpgradeChangeDefinition.java
>  5428ea7 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigureTask.java
>  d7bb338 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml 
> 40052d8 
>   
> ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.6.xml
>  09608a0 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.6.xml 
> 949a174 
>   ambari-server/src/main/resources/upgrade-config.xsd e274451 
>   
> ambari-server/src/test/java/org/apache/ambari/server/serveraction/upgrades/ConfigureActionTest.java
>  92fa084 
> 
> Diff: https://reviews.apache.org/r/55597/diff/
> 
> 
> Testing
> ---
> 
> Tests run: 4857, Failures: 0, Errors: 0, Skipped: 38
> 
> [INFO] 
> 
> [INFO] BUILD SUCCESS
> [INFO] 
> 
> [INFO] Total time: 26:49 min
> [INFO] Finished at: 2017-01-16T20:53:37-05:00
> [INFO] Final Memory: 55M/708M
> [INFO] 
> 
> 
> 
> Thanks,
> 
> Jonathan Hurley
> 
>



Re: Review Request 55291: AMBARI-19411: Atlas AMS support

2017-01-17 Thread Apoorv Naik

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55291/
---

(Updated Jan. 17, 2017, 7:40 p.m.)


Review request for Ambari, Aravindan Vijayan and Sid Wagle.


Changes
---

Handled thread dying issue when the connection to AMS fails.


Repository: ambari


Description
---

AMBARI-19411: Atlas AMS support


Diffs (updated)
-

  ambari-metrics/ambari-metrics-assembly/pom.xml cdcc2a7181 
  ambari-metrics/ambari-metrics-assembly/src/main/package/deb/control/postinst 
e75d557027 
  
ambari-metrics/ambari-metrics-assembly/src/main/package/rpm/sink/postinstall.sh 
e75d557027 
  ambari-metrics/ambari-metrics-atlas-sink/pom.xml PRE-CREATION 
  ambari-metrics/ambari-metrics-atlas-sink/src/main/assemblies/empty.xml 
PRE-CREATION 
  
ambari-metrics/ambari-metrics-atlas-sink/src/main/assemblies/jar-with-common.xml
 PRE-CREATION 
  
ambari-metrics/ambari-metrics-atlas-sink/src/main/java/org/apache/hadoop/metrics/sink/atlas/AtlasMetricsReporter.java
 PRE-CREATION 
  
ambari-metrics/ambari-metrics-atlas-sink/src/test/java/org/apache/hadoop/metrics2/sink/atlas/AtlasMetricsReporterTest.java
 PRE-CREATION 
  ambari-metrics/pom.xml 2d88912695 
  
ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/params.py
 94193be5ee 
  
ambari-server/src/main/resources/common-services/ATLAS/0.8.0.0.0/configuration/application-properties.xml
 PRE-CREATION 
  
ambari-server/src/main/resources/common-services/ATLAS/0.8.0.0.0/configuration/atlas-log4j.xml
 PRE-CREATION 
  
ambari-server/src/main/resources/common-services/ATLAS/0.8.0.0.0/configuration/atlas-solrconfig.xml
 PRE-CREATION 
  
ambari-server/src/main/resources/common-services/ATLAS/0.8.0.0.0/kerberos.json 
PRE-CREATION 
  ambari-server/src/main/resources/common-services/ATLAS/0.8.0.0.0/metainfo.xml 
PRE-CREATION 
  ambari-server/src/main/resources/common-services/ATLAS/0.8.0.0.0/metrics.json 
PRE-CREATION 
  
ambari-server/src/main/resources/common-services/ATLAS/0.8.0.0.0/quicklinks/quicklinks.json
 PRE-CREATION 
  
ambari-server/src/main/resources/common-services/ATLAS/0.8.0.0.0/role_command_order.json
 PRE-CREATION 
  
ambari-server/src/main/resources/common-services/ATLAS/0.8.0.0.0/themes/theme.json
 PRE-CREATION 
  ambari-server/src/main/resources/common-services/ATLAS/0.8.0.0.0/widgets.json 
PRE-CREATION 
  
ambari-server/src/main/resources/stacks/HDP/2.6/services/ATLAS/configuration/application-properties.xml
 47e1fb5376 
  
ambari-server/src/main/resources/stacks/HDP/2.6/services/ATLAS/configuration/atlas-env.xml
 PRE-CREATION 

Diff: https://reviews.apache.org/r/55291/diff/


Testing
---


Thanks,

Apoorv Naik



Review Request 55634: ZKFC version shows incorrect in DB tables upon downgrade

2017-01-17 Thread Nate Cole

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55634/
---

Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.


Bugs: AMBARI-19596
https://issues.apache.org/jira/browse/AMBARI-19596


Repository: ambari


Description
---

Steps:
* Install ZKFC using HDP-2.3.
* Register a version for HDP-2.6
* Start Upgrade
* At first chance, start Downgrade

In HDP-2.6, ZKFC is marked as {{versionAdvertised=false}}.  In HDP-2.6, 
{{versionAdvertised=true}}.  On downgrade, that component's desired version 
should be marked UNKNOWN with upgrade state of NONE.


Diffs
-


Diff: https://reviews.apache.org/r/55634/diff/


Testing
---

Manual.  Automated pending.


Thanks,

Nate Cole



Re: Review Request 55597: Add upgrade logic for the heap dump control option added in HDP 2.6 stack.

2017-01-17 Thread Jonathan Hurley


> On Jan. 17, 2017, 2:13 p.m., Alejandro Fernandez wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java,
> >  line 498
> > 
> >
> > What do you think about checking if valueToInsert is already present in 
> > the config?
> > 
> > If we want to be more strict, we can check during APPEND that it 
> > doesn't already exist at the end, and during PREPEND that it doesn't 
> > already exist at the beginning.
> > 
> > This should help in cases where the existing config value may already 
> > contain in, and to make this idempotent.

We already check for whether it exists in the config. Rob was saying that it 
was too restrictive, so I proposed that we could check beginsWith or endsWith 
... but that can be defeated easily with `content` sections since people add to 
those all the time. That's why I'd rather worry about the edge cases in a 
separate Jira.


- Jonathan


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55597/#review161911
---


On Jan. 16, 2017, 9:54 p.m., Jonathan Hurley wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55597/
> ---
> 
> (Updated Jan. 16, 2017, 9:54 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko, Nate Cole, and Robert Levas.
> 
> 
> Bugs: AMBARI-19574
> https://issues.apache.org/jira/browse/AMBARI-19574
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> There's a fuller description in the Jira issue, but just to sum up for easy 
> of reading:
> 
> - Hive added some properties in HDP 2.6
> - To upgrade these properties, existing content would need to be modified. 
> Unfortunately, find/replace isn't an option here
> - I created a very simple  directive to prepend/append properties
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java
>  97280ee 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigUpgradeChangeDefinition.java
>  5428ea7 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigureTask.java
>  d7bb338 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml 
> 40052d8 
>   
> ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.6.xml
>  09608a0 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.6.xml 
> 949a174 
>   ambari-server/src/main/resources/upgrade-config.xsd e274451 
>   
> ambari-server/src/test/java/org/apache/ambari/server/serveraction/upgrades/ConfigureActionTest.java
>  92fa084 
> 
> Diff: https://reviews.apache.org/r/55597/diff/
> 
> 
> Testing
> ---
> 
> Tests run: 4857, Failures: 0, Errors: 0, Skipped: 38
> 
> [INFO] 
> 
> [INFO] BUILD SUCCESS
> [INFO] 
> 
> [INFO] Total time: 26:49 min
> [INFO] Finished at: 2017-01-16T20:53:37-05:00
> [INFO] Final Memory: 55M/708M
> [INFO] 
> 
> 
> 
> Thanks,
> 
> Jonathan Hurley
> 
>



Re: Review Request 55597: Add upgrade logic for the heap dump control option added in HDP 2.6 stack.

2017-01-17 Thread Robert Levas


> On Jan. 17, 2017, 9:47 a.m., Robert Levas wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java,
> >  line 479
> > 
> >
> > `contains` seems to be a little relaxed here. What if we are inserting 
> > FOO into a value where FOOBAR exists.  FOO will not be inserted.
> 
> Jonathan Hurley wrote:
> Relaxed, yes, but I think that's why this never made it into Ambari in 
> previous versions. Because questions like this exposed a ton of weird edge 
> cases. And then we end up without the ability to insert content at all.
> 
> This was meant as a first attempt to get the new properties in - I can 
> open another Jira for tracking this since I don't see a good solution 
> currently. Would that be sufficient?
> 
> Jonathan Hurley wrote:
> Do you think a "beginsWith" and "endsWith" would be sufficient here? 
> Since we're currently only prepending/appending, would that make sense?

I suppopse this can be dropped as long as it is known.  But maybe a regular 
expression match to create a search for "whole words" - ala IntelliJ's "Whole 
words only" search feature.

Example:
```
\bFOO\b
```


> On Jan. 17, 2017, 9:47 a.m., Robert Levas wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java,
> >  lines 488-491
> > 
> >
> > Does it make sense to _prepend_ a value where the line separator comes 
> > before the value?  
> > 
> > ```
> > \nFOO + BAR\nBAZ = \nFOOBAR\nBAZ
> > ```
> > 
> > (Or maybe I am not interpreting this correctly)
> 
> Jonathan Hurley wrote:
> Does it make sense? Perhaps not - but it's an option and if that's what 
> is selected, then we'll do it. There may be a case for it depending on how 2 
> files might be merged together by some service. For example, if it combines 
> two shell script templates into 1 - you might want that extra newline.

I should have dropped this after I realized what the usecase for this feature 
is.  Dropping now.


> On Jan. 17, 2017, 9:47 a.m., Robert Levas wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java,
> >  lines 493-496
> > 
> >
> > Does it make sense to _append_ a value where the line separator comes 
> > after the value?  
> > 
> > ```
> > BAR\nBAZ + FOO\n  = BAR\nBAZFOO\n
> > ```
> > 
> > (Or maybe I am not interpreting this correctly)
> 
> Jonathan Hurley wrote:
> I definitely think it does - Git warns you if you don't have a trailing 
> newline in new files. Also, some editors like vi might put the text too low, 
> so developers like adding an extra newline :)

I should have dropped this after I realized what the usecase for this feature 
is.  Dropping now.


- Robert


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55597/#review161868
---


On Jan. 16, 2017, 9:54 p.m., Jonathan Hurley wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55597/
> ---
> 
> (Updated Jan. 16, 2017, 9:54 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko, Nate Cole, and Robert Levas.
> 
> 
> Bugs: AMBARI-19574
> https://issues.apache.org/jira/browse/AMBARI-19574
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> There's a fuller description in the Jira issue, but just to sum up for easy 
> of reading:
> 
> - Hive added some properties in HDP 2.6
> - To upgrade these properties, existing content would need to be modified. 
> Unfortunately, find/replace isn't an option here
> - I created a very simple  directive to prepend/append properties
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java
>  97280ee 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigUpgradeChangeDefinition.java
>  5428ea7 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigureTask.java
>  d7bb338 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml 
> 40052d8 
>   
> ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.6.xml
>  09608a0 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.6.xml 
> 949a174 
>   ambari-server/src/main/resources/upgrade-config.xsd e274451 
>   
> ambari-server/src/test/java/org/apache/ambari/server/serveraction/upgrades/ConfigureActionTest.java
>  92fa084 
> 
> Dif

Re: Review Request 55516: Workflow Manager View: Start record set to 1 even when there are no records

2017-01-17 Thread DIPAYAN BHOWMICK

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55516/#review161916
---




contrib/views/wfmanager/src/main/resources/ui/app/routes/design/dashboardtab.js 
(line 140)


Can we conditional ternary operator as an expression and change the code 
like: 

res.start = res.total > 0 ? start : 0;

Looks, much cleaner to me.


- DIPAYAN BHOWMICK


On Jan. 17, 2017, 5:53 p.m., Sangeeta Ravindran wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55516/
> ---
> 
> (Updated Jan. 17, 2017, 5:53 p.m.)
> 
> 
> Review request for Ambari, Di Li, DIPAYAN BHOWMICK, and Nitiraj Rathore.
> 
> 
> Bugs: AMBARI-19475
> https://issues.apache.org/jira/browse/AMBARI-19475
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> In the Workflow Manager View, when there are no co-ordinator or bundle 
> records, the dashboard message says "Showing 1 to 0 of 0 records". This is 
> because the start record is set to 1 by default.
> 
> Fix is to set the start record to 0, if the total records is 0.
> 
> 
> Diffs
> -
> 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/routes/design/dashboardtab.js
>  78bc1c9 
> 
> Diff: https://reviews.apache.org/r/55516/diff/
> 
> 
> Testing
> ---
> 
> Manual testing.
> 
> 
> Thanks,
> 
> Sangeeta Ravindran
> 
>



Re: Review Request 55597: Add upgrade logic for the heap dump control option added in HDP 2.6 stack.

2017-01-17 Thread Alejandro Fernandez

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55597/#review161911
---




ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java
 (line 495)


What do you think about checking if valueToInsert is already present in the 
config?

If we want to be more strict, we can check during APPEND that it doesn't 
already exist at the end, and during PREPEND that it doesn't already exist at 
the beginning.

This should help in cases where the existing config value may already 
contain in, and to make this idempotent.


- Alejandro Fernandez


On Jan. 17, 2017, 2:54 a.m., Jonathan Hurley wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55597/
> ---
> 
> (Updated Jan. 17, 2017, 2:54 a.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko, Nate Cole, and Robert Levas.
> 
> 
> Bugs: AMBARI-19574
> https://issues.apache.org/jira/browse/AMBARI-19574
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> There's a fuller description in the Jira issue, but just to sum up for easy 
> of reading:
> 
> - Hive added some properties in HDP 2.6
> - To upgrade these properties, existing content would need to be modified. 
> Unfortunately, find/replace isn't an option here
> - I created a very simple  directive to prepend/append properties
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java
>  97280ee 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigUpgradeChangeDefinition.java
>  5428ea7 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigureTask.java
>  d7bb338 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml 
> 40052d8 
>   
> ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.6.xml
>  09608a0 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.6.xml 
> 949a174 
>   ambari-server/src/main/resources/upgrade-config.xsd e274451 
>   
> ambari-server/src/test/java/org/apache/ambari/server/serveraction/upgrades/ConfigureActionTest.java
>  92fa084 
> 
> Diff: https://reviews.apache.org/r/55597/diff/
> 
> 
> Testing
> ---
> 
> Tests run: 4857, Failures: 0, Errors: 0, Skipped: 38
> 
> [INFO] 
> 
> [INFO] BUILD SUCCESS
> [INFO] 
> 
> [INFO] Total time: 26:49 min
> [INFO] Finished at: 2017-01-16T20:53:37-05:00
> [INFO] Final Memory: 55M/708M
> [INFO] 
> 
> 
> 
> Thanks,
> 
> Jonathan Hurley
> 
>



Re: Review Request 55556: ranger_usersync should install with ranger_admin in the same host

2017-01-17 Thread Alejandro Fernandez

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/6/#review161910
---




ambari-web/app/models/stack_service_component.js (line 200)


The standard is to provide that information in the metainfo file for 
several good reasons.
* Support multiple stacks which may have differences in behavior
* Support multiple versions of the same stack which may have differences in 
behavior
* Abstract knowledge of the web-layer having to know about Hadoop

I think the 2nd approach is more consistent with the rest of Ambari.


- Alejandro Fernandez


On Jan. 17, 2017, 2:12 a.m., alice alice wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/6/
> ---
> 
> (Updated Jan. 17, 2017, 2:12 a.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Jaimin Jetly, Jayush Luniya, 
> Zhe (Joe) Wang, Richard Zang, Sumit Mohanty, Sid Wagle, and Yusaku Sako.
> 
> 
> Bugs: AMBARI-19557
> https://issues.apache.org/jira/browse/AMBARI-19557
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_Ranger_Install_Guide/content/ch03s01.html??
> The Ranger Admin and Ranger Usersync services must be installed on the same 
> cluster node.
> so we'd betted install ranger_admin and ranger_usersync in same cluster node 
> in instaling at managing master hostcomponent
> 
> 
> Diffs
> -
> 
>   ambari-web/app/models/stack_service_component.js 17c2aa1 
> 
> Diff: https://reviews.apache.org/r/6/diff/
> 
> 
> Testing
> ---
> 
> done it
> 
> 
> Thanks,
> 
> alice alice
> 
>



Re: Review Request 55597: Add upgrade logic for the heap dump control option added in HDP 2.6 stack.

2017-01-17 Thread Jonathan Hurley


> On Jan. 17, 2017, 9:47 a.m., Robert Levas wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java,
> >  line 479
> > 
> >
> > `contains` seems to be a little relaxed here. What if we are inserting 
> > FOO into a value where FOOBAR exists.  FOO will not be inserted.
> 
> Jonathan Hurley wrote:
> Relaxed, yes, but I think that's why this never made it into Ambari in 
> previous versions. Because questions like this exposed a ton of weird edge 
> cases. And then we end up without the ability to insert content at all.
> 
> This was meant as a first attempt to get the new properties in - I can 
> open another Jira for tracking this since I don't see a good solution 
> currently. Would that be sufficient?

Do you think a "beginsWith" and "endsWith" would be sufficient here? Since 
we're currently only prepending/appending, would that make sense?


- Jonathan


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55597/#review161868
---


On Jan. 16, 2017, 9:54 p.m., Jonathan Hurley wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55597/
> ---
> 
> (Updated Jan. 16, 2017, 9:54 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko, Nate Cole, and Robert Levas.
> 
> 
> Bugs: AMBARI-19574
> https://issues.apache.org/jira/browse/AMBARI-19574
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> There's a fuller description in the Jira issue, but just to sum up for easy 
> of reading:
> 
> - Hive added some properties in HDP 2.6
> - To upgrade these properties, existing content would need to be modified. 
> Unfortunately, find/replace isn't an option here
> - I created a very simple  directive to prepend/append properties
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java
>  97280ee 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigUpgradeChangeDefinition.java
>  5428ea7 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigureTask.java
>  d7bb338 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml 
> 40052d8 
>   
> ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.6.xml
>  09608a0 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.6.xml 
> 949a174 
>   ambari-server/src/main/resources/upgrade-config.xsd e274451 
>   
> ambari-server/src/test/java/org/apache/ambari/server/serveraction/upgrades/ConfigureActionTest.java
>  92fa084 
> 
> Diff: https://reviews.apache.org/r/55597/diff/
> 
> 
> Testing
> ---
> 
> Tests run: 4857, Failures: 0, Errors: 0, Skipped: 38
> 
> [INFO] 
> 
> [INFO] BUILD SUCCESS
> [INFO] 
> 
> [INFO] Total time: 26:49 min
> [INFO] Finished at: 2017-01-16T20:53:37-05:00
> [INFO] Final Memory: 55M/708M
> [INFO] 
> 
> 
> 
> Thanks,
> 
> Jonathan Hurley
> 
>



Re: Review Request 55597: Add upgrade logic for the heap dump control option added in HDP 2.6 stack.

2017-01-17 Thread Jonathan Hurley


> On Jan. 17, 2017, 9:47 a.m., Robert Levas wrote:
> > The implementation accounts only for adding content to a line-delimited 
> > string value.  Would there be a need to insert a value into a string with a 
> > different delimiater?  Maybe a comma (,)?
> 
> Jonathan Hurley wrote:
> No, I don't think so. Consider this:
> ` insert-type="append" newline-before="false" newline-after="false" />`
> 
> This will change
> llap_java_opts=-Dfoo -Dbar
> into
> llap_java_opts=-Dfoo -Dbar {{heap_dump_opts}}
> 
> Doesn't require any line-delimiting.

Ah, I also see what you're saying now ... That when we do put in a delimiter, 
we're using a newline as the character. Perhaps if the need arises in the 
future, we can certainly define the character to use. However, as with all 
upgrade pack directives, we'd rather start small and only add functionality 
when it's needed.


- Jonathan


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55597/#review161868
---


On Jan. 16, 2017, 9:54 p.m., Jonathan Hurley wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55597/
> ---
> 
> (Updated Jan. 16, 2017, 9:54 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko, Nate Cole, and Robert Levas.
> 
> 
> Bugs: AMBARI-19574
> https://issues.apache.org/jira/browse/AMBARI-19574
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> There's a fuller description in the Jira issue, but just to sum up for easy 
> of reading:
> 
> - Hive added some properties in HDP 2.6
> - To upgrade these properties, existing content would need to be modified. 
> Unfortunately, find/replace isn't an option here
> - I created a very simple  directive to prepend/append properties
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java
>  97280ee 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigUpgradeChangeDefinition.java
>  5428ea7 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigureTask.java
>  d7bb338 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml 
> 40052d8 
>   
> ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.6.xml
>  09608a0 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.6.xml 
> 949a174 
>   ambari-server/src/main/resources/upgrade-config.xsd e274451 
>   
> ambari-server/src/test/java/org/apache/ambari/server/serveraction/upgrades/ConfigureActionTest.java
>  92fa084 
> 
> Diff: https://reviews.apache.org/r/55597/diff/
> 
> 
> Testing
> ---
> 
> Tests run: 4857, Failures: 0, Errors: 0, Skipped: 38
> 
> [INFO] 
> 
> [INFO] BUILD SUCCESS
> [INFO] 
> 
> [INFO] Total time: 26:49 min
> [INFO] Finished at: 2017-01-16T20:53:37-05:00
> [INFO] Final Memory: 55M/708M
> [INFO] 
> 
> 
> 
> Thanks,
> 
> Jonathan Hurley
> 
>



Re: Review Request 55516: Workflow Manager View: Start record set to 1 even when there are no records

2017-01-17 Thread Di Li

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55516/#review161901
---


Ship it!




Ship It!

- Di Li


On Jan. 17, 2017, 5:53 p.m., Sangeeta Ravindran wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55516/
> ---
> 
> (Updated Jan. 17, 2017, 5:53 p.m.)
> 
> 
> Review request for Ambari, Di Li, DIPAYAN BHOWMICK, and Nitiraj Rathore.
> 
> 
> Bugs: AMBARI-19475
> https://issues.apache.org/jira/browse/AMBARI-19475
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> In the Workflow Manager View, when there are no co-ordinator or bundle 
> records, the dashboard message says "Showing 1 to 0 of 0 records". This is 
> because the start record is set to 1 by default.
> 
> Fix is to set the start record to 0, if the total records is 0.
> 
> 
> Diffs
> -
> 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/routes/design/dashboardtab.js
>  78bc1c9 
> 
> Diff: https://reviews.apache.org/r/55516/diff/
> 
> 
> Testing
> ---
> 
> Manual testing.
> 
> 
> Thanks,
> 
> Sangeeta Ravindran
> 
>



Re: Review Request 55596: AMBARI-19576 - Downgrade request fails as existing Upgrade request is considered 'in progress'

2017-01-17 Thread Xi Wang

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55596/#review161894
---


Ship it!




Ship It!

- Xi Wang


On Jan. 16, 2017, 6:17 p.m., Richard Zang wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55596/
> ---
> 
> (Updated Jan. 16, 2017, 6:17 p.m.)
> 
> 
> Review request for Ambari, Jaimin Jetly and Xi Wang.
> 
> 
> Bugs: AMBARI-19576
> https://issues.apache.org/jira/browse/AMBARI-19576
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Wait for the request_status = ABORTED before initializing downgrade.
> 
> 
> Diffs
> -
> 
>   ambari-web/app/controllers/main/admin/stack_and_upgrade_controller.js 
> 3058580 
>   ambari-web/test/controllers/main/admin/stack_and_upgrade_controller_test.js 
> 78e81a0 
> 
> Diff: https://reviews.apache.org/r/55596/diff/
> 
> 
> Testing
> ---
> 
> Manually tested on live cluster.
> All unit tests passed.
>   30297 passing (21s)
>   157 pending
> 
> 
> Thanks,
> 
> Richard Zang
> 
>



Re: Review Request 55630: Hbase, Zookeeper start failed

2017-01-17 Thread Jayush Luniya

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55630/#review161892
---


Ship it!




Ship It!

- Jayush Luniya


On Jan. 17, 2017, 4:38 p.m., Andrew Onischuk wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55630/
> ---
> 
> (Updated Jan. 17, 2017, 4:38 p.m.)
> 
> 
> Review request for Ambari and Dmitro Lisnichenko.
> 
> 
> Bugs: AMBARI-19593
> https://issues.apache.org/jira/browse/AMBARI-19593
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Hbase master and zookeeper server start failed with
> 
> 
> 
> 
> "href" : 
> "http://172.22.119.57:8080/api/v1/clusters/cl1/requests/19/tasks/354";,
>   "Tasks" : {
> "attempt_cnt" : 1,
> "cluster_name" : "cl1",
> "command" : "START",
> "command_detail" : "HBASE_MASTER START",
> "end_time" : 1484027047948,
> "error_log" : "/var/lib/ambari-agent/data/errors-354.txt",
> "exit_code" : 1,
> "host_name" : "nat-d7-hxks-ambari-kerb-ad-2-2.openstacklocal",
> "id" : 354,
> "output_log" : "/var/lib/ambari-agent/data/output-354.txt",
> "request_id" : 19,
> "role" : "HBASE_MASTER",
> "stage_id" : 1,
> "start_time" : 1484027045724,
> "status" : "FAILED",
> "stderr" : "Traceback (most recent call last):\n  File 
> \"/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_master.py\",
>  line 157, in \nHbaseMaster().execute()\n  File 
> \"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py\",
>  line 287, in execute\nmethod(env)\n  File 
> \"/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_master.py\",
>  line 84, in start\nself.configure(env) # for security\n  File 
> \"/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_master.py\",
>  line 39, in configure\nhbase(name='master')\n  File 
> \"/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py\", line 
> 89, in thunk\nreturn fn(*args, **kwargs)\n  File 
> \"/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase.py\",
>  line 199, in hbase\nowner=params.hbase_user\n  File 
> \"/usr/lib/python2.6/site-packages/resource_managem
 ent/core/base.py\", line 155, in __init__\nself.env.run()\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/core/environment.py\", 
line 160, in run\nself.run_action(resource, action)\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/core/environment.py\", 
line 124, in run_action\nprovider_action()\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py\",
 line 459, in action_create_on_execute\nself.action_delayed(\"create\")\n  
File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py\",
 line 456, in action_delayed\n
self.get_hdfs_resource_executor().action_delayed(action_name, self)\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py\",
 line 247, in action_delayed\nself._assert_valid()\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py\",
 line 231, in _asse
 rt_valid\nself.target_status = self._get_file_status(target)\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py\",
 line 292, in _get_file_status\nlist_status = self.util.run_command(target, 
'GETFILESTATUS', method='GET', ignore_status_codes=['404'], 
assertable_result=False)\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py\",
 line 179, in run_command\n_, out, err = get_user_call_output(cmd, 
user=self.run_user, logoutput=self.logoutput, quiet=False)\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/functions/get_user_call_output.py\",
 line 61, in get_user_call_output\nraise ExecutionFailed(err_msg, code, 
files_output[0], 
files_output[1])\nresource_management.core.exceptions.ExecutionFailed: 
Execution of 'curl -sS -L -w '%{http_code}' -X GET --negotiate -u : 
'http://nat-d7-hxks-ambari-kerb-ad-2-5.openstacklocal:20070/webhdfs/v1/apps/hbase/data?op=GE
 TFILESTATUS&user.name=cstm-hdfs' 1>/tmp/tmpLtFPf0 2>/tmp/tmppl_1zh' returned 
7. curl: (7) couldn't connect to host\n000",
> 
> 
> 
> "href" : 
> "http://172.22.119.57:8080/api/v1/clusters/cl1/requests/20/tasks/381";,
>   "Tasks" : {
> "attempt_cnt" : 1,
> "cluster_name" : "cl1",
> "command" : "START",
>   

Re: Review Request 55429: Run ZK operations in logsearch internally and enable ACL security for LogSearch/Solr

2017-01-17 Thread Oliver Szabo

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55429/
---

(Updated Jan. 17, 2017, 5:08 p.m.)


Review request for Ambari, Miklos Gergely and Robert Nettleton.


Changes
---

added global state filtering and create async collection commands


Bugs: AMBARI-19468
https://issues.apache.org/jira/browse/AMBARI-19468


Repository: ambari


Description (updated)
---

- added setAcl operation inside logsearch code
- added reload collection command (on schema or solrconfig change)
- removed logsearch solr client dependency
- refactor some methods to handlers in collection dao
- removed upload configurations call from ambari logsearch stack code.
- enable ACL security for Log Search / Infra Solr
- fixed jinja template generation in solr-client log4j config
- added global states (audit, service and config collection)
- added rest api filter based on global states
- create async upload config / check znode / collection creation / reloading / 
set acl commands
- removed collection dao and alias dao


Diffs (updated)
-

  
ambari-common/src/main/python/resource_management/libraries/functions/solr_cloud_util.py
 2e48c6a 
  ambari-logsearch/ambari-logsearch-portal/pom.xml 9d17fe4 
  
ambari-logsearch/ambari-logsearch-portal/src/main/configsets/audit_logs/conf/managed-schema
 4cd412b 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/common/ACLPropertiesSplitter.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SecurityConfig.java
 c99a738 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SolrAuditLogPropsConfig.java
 d270b13 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SolrConfig.java
 fb25a63 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SolrConnectionPropsConfig.java
 82dd7df 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/SolrPropsConfig.java
 f80d6e5 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/global/SolrAuditLogsState.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/global/SolrCollectionState.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/global/SolrServiceLogsState.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/conf/global/SolrUserConfigState.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/configurer/LogfeederFilterConfigurer.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/configurer/SolrAuditAliasConfigurer.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/configurer/SolrCollectionConfigurer.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/configurer/SolrConfigurer.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/AuditSolrDao.java
 309687d 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/ServiceLogsSolrDao.java
 cf61163 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/SolrAliasDao.java
 d78ff0da 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/SolrCollectionDao.java
 da76924 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/SolrDaoBase.java
 39b65ae 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/SolrSchemaFieldDao.java
 e6a562e 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/dao/UserConfigSolrDao.java
 106bedc 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/handler/ACLHandler.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/handler/CreateCollectionHandler.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/handler/ListCollectionHandler.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/handler/ReloadCollectionHandler.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/handler/SolrZkRequestHandler.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/handler/UploadConfigurationHandler.java
 PRE-CREATION 
  
amb

Re: Review Request 55630: Hbase, Zookeeper start failed

2017-01-17 Thread Dmitro Lisnichenko

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55630/#review161885
---


Ship it!




Ship It!

- Dmitro Lisnichenko


On Jan. 17, 2017, 6:38 p.m., Andrew Onischuk wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55630/
> ---
> 
> (Updated Jan. 17, 2017, 6:38 p.m.)
> 
> 
> Review request for Ambari and Dmitro Lisnichenko.
> 
> 
> Bugs: AMBARI-19593
> https://issues.apache.org/jira/browse/AMBARI-19593
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Hbase master and zookeeper server start failed with
> 
> 
> 
> 
> "href" : 
> "http://172.22.119.57:8080/api/v1/clusters/cl1/requests/19/tasks/354";,
>   "Tasks" : {
> "attempt_cnt" : 1,
> "cluster_name" : "cl1",
> "command" : "START",
> "command_detail" : "HBASE_MASTER START",
> "end_time" : 1484027047948,
> "error_log" : "/var/lib/ambari-agent/data/errors-354.txt",
> "exit_code" : 1,
> "host_name" : "nat-d7-hxks-ambari-kerb-ad-2-2.openstacklocal",
> "id" : 354,
> "output_log" : "/var/lib/ambari-agent/data/output-354.txt",
> "request_id" : 19,
> "role" : "HBASE_MASTER",
> "stage_id" : 1,
> "start_time" : 1484027045724,
> "status" : "FAILED",
> "stderr" : "Traceback (most recent call last):\n  File 
> \"/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_master.py\",
>  line 157, in \nHbaseMaster().execute()\n  File 
> \"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py\",
>  line 287, in execute\nmethod(env)\n  File 
> \"/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_master.py\",
>  line 84, in start\nself.configure(env) # for security\n  File 
> \"/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_master.py\",
>  line 39, in configure\nhbase(name='master')\n  File 
> \"/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py\", line 
> 89, in thunk\nreturn fn(*args, **kwargs)\n  File 
> \"/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase.py\",
>  line 199, in hbase\nowner=params.hbase_user\n  File 
> \"/usr/lib/python2.6/site-packages/resource_managem
 ent/core/base.py\", line 155, in __init__\nself.env.run()\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/core/environment.py\", 
line 160, in run\nself.run_action(resource, action)\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/core/environment.py\", 
line 124, in run_action\nprovider_action()\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py\",
 line 459, in action_create_on_execute\nself.action_delayed(\"create\")\n  
File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py\",
 line 456, in action_delayed\n
self.get_hdfs_resource_executor().action_delayed(action_name, self)\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py\",
 line 247, in action_delayed\nself._assert_valid()\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py\",
 line 231, in _asse
 rt_valid\nself.target_status = self._get_file_status(target)\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py\",
 line 292, in _get_file_status\nlist_status = self.util.run_command(target, 
'GETFILESTATUS', method='GET', ignore_status_codes=['404'], 
assertable_result=False)\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py\",
 line 179, in run_command\n_, out, err = get_user_call_output(cmd, 
user=self.run_user, logoutput=self.logoutput, quiet=False)\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/functions/get_user_call_output.py\",
 line 61, in get_user_call_output\nraise ExecutionFailed(err_msg, code, 
files_output[0], 
files_output[1])\nresource_management.core.exceptions.ExecutionFailed: 
Execution of 'curl -sS -L -w '%{http_code}' -X GET --negotiate -u : 
'http://nat-d7-hxks-ambari-kerb-ad-2-5.openstacklocal:20070/webhdfs/v1/apps/hbase/data?op=GE
 TFILESTATUS&user.name=cstm-hdfs' 1>/tmp/tmpLtFPf0 2>/tmp/tmppl_1zh' returned 
7. curl: (7) couldn't connect to host\n000",
> 
> 
> 
> "href" : 
> "http://172.22.119.57:8080/api/v1/clusters/cl1/requests/20/tasks/381";,
>   "Tasks" : {
> "attempt_cnt" : 1,
> "cluster_name" : "cl1",
> "command" : "START",
>  

Re: Review Request 55628: Add/delete host component: visual changes for configuration popup

2017-01-17 Thread Alexandr Antonenko

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55628/#review161882
---


Ship it!




Ship It!

- Alexandr Antonenko


On Jan. 17, 2017, 4:32 p.m., Andriy Babiichuk wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55628/
> ---
> 
> (Updated Jan. 17, 2017, 4:32 p.m.)
> 
> 
> Review request for Ambari and Alexandr Antonenko.
> 
> 
> Bugs: AMBARI-19590
> https://issues.apache.org/jira/browse/AMBARI-19590
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> - Information div similar to "Recommended Changes" one should be added for 
> "Required Changes" as well. This should say "The following configuration 
> changes are required and will be applied automatically."
> - There's not enough spacing between confirnation message and the information 
> div itself.
> - The information div for recommended changes should come after the header 
> "Recommended Changes".  Similarly, the information div for required changes 
> should come after the header "Required Changes".
> 
> 
> Diffs
> -
> 
>   ambari-web/app/messages.js cacb798 
>   ambari-web/app/templates/common/modal_popups/dependent_configs_list.hbs 
> af84306 
> 
> Diff: https://reviews.apache.org/r/55628/diff/
> 
> 
> Testing
> ---
> 
> 20395 tests complete (33 seconds)
>   153 tests pending
> 
> 
> Thanks,
> 
> Andriy Babiichuk
> 
>



Review Request 55628: Add/delete host component: visual changes for configuration popup

2017-01-17 Thread Andriy Babiichuk

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55628/
---

Review request for Ambari and Alexandr Antonenko.


Bugs: AMBARI-19590
https://issues.apache.org/jira/browse/AMBARI-19590


Repository: ambari


Description
---

- Information div similar to "Recommended Changes" one should be added for 
"Required Changes" as well. This should say "The following configuration 
changes are required and will be applied automatically."
- There's not enough spacing between confirnation message and the information 
div itself.
- The information div for recommended changes should come after the header 
"Recommended Changes".  Similarly, the information div for required changes 
should come after the header "Required Changes".


Diffs
-

  ambari-web/app/messages.js cacb798 
  ambari-web/app/templates/common/modal_popups/dependent_configs_list.hbs 
af84306 

Diff: https://reviews.apache.org/r/55628/diff/


Testing
---

20395 tests complete (33 seconds)
  153 tests pending


Thanks,

Andriy Babiichuk



Review Request 55630: Hbase, Zookeeper start failed

2017-01-17 Thread Andrew Onischuk

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55630/
---

Review request for Ambari and Dmitro Lisnichenko.


Bugs: AMBARI-19593
https://issues.apache.org/jira/browse/AMBARI-19593


Repository: ambari


Description
---

Hbase master and zookeeper server start failed with




"href" : 
"http://172.22.119.57:8080/api/v1/clusters/cl1/requests/19/tasks/354";,
  "Tasks" : {
"attempt_cnt" : 1,
"cluster_name" : "cl1",
"command" : "START",
"command_detail" : "HBASE_MASTER START",
"end_time" : 1484027047948,
"error_log" : "/var/lib/ambari-agent/data/errors-354.txt",
"exit_code" : 1,
"host_name" : "nat-d7-hxks-ambari-kerb-ad-2-2.openstacklocal",
"id" : 354,
"output_log" : "/var/lib/ambari-agent/data/output-354.txt",
"request_id" : 19,
"role" : "HBASE_MASTER",
"stage_id" : 1,
"start_time" : 1484027045724,
"status" : "FAILED",
"stderr" : "Traceback (most recent call last):\n  File 
\"/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_master.py\",
 line 157, in \nHbaseMaster().execute()\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py\",
 line 287, in execute\nmethod(env)\n  File 
\"/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_master.py\",
 line 84, in start\nself.configure(env) # for security\n  File 
\"/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_master.py\",
 line 39, in configure\nhbase(name='master')\n  File 
\"/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py\", line 89, 
in thunk\nreturn fn(*args, **kwargs)\n  File 
\"/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase.py\",
 line 199, in hbase\nowner=params.hbase_user\n  File 
\"/usr/lib/python2.6/site-packages/resource_managemen
 t/core/base.py\", line 155, in __init__\nself.env.run()\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/core/environment.py\", 
line 160, in run\nself.run_action(resource, action)\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/core/environment.py\", 
line 124, in run_action\nprovider_action()\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py\",
 line 459, in action_create_on_execute\nself.action_delayed(\"create\")\n  
File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py\",
 line 456, in action_delayed\n
self.get_hdfs_resource_executor().action_delayed(action_name, self)\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py\",
 line 247, in action_delayed\nself._assert_valid()\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py\",
 line 231, in _assert
 _valid\nself.target_status = self._get_file_status(target)\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py\",
 line 292, in _get_file_status\nlist_status = self.util.run_command(target, 
'GETFILESTATUS', method='GET', ignore_status_codes=['404'], 
assertable_result=False)\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py\",
 line 179, in run_command\n_, out, err = get_user_call_output(cmd, 
user=self.run_user, logoutput=self.logoutput, quiet=False)\n  File 
\"/usr/lib/python2.6/site-packages/resource_management/libraries/functions/get_user_call_output.py\",
 line 61, in get_user_call_output\nraise ExecutionFailed(err_msg, code, 
files_output[0], 
files_output[1])\nresource_management.core.exceptions.ExecutionFailed: 
Execution of 'curl -sS -L -w '%{http_code}' -X GET --negotiate -u : 
'http://nat-d7-hxks-ambari-kerb-ad-2-5.openstacklocal:20070/webhdfs/v1/apps/hbase/data?op=GETF
 ILESTATUS&user.name=cstm-hdfs' 1>/tmp/tmpLtFPf0 2>/tmp/tmppl_1zh' returned 7. 
curl: (7) couldn't connect to host\n000",



"href" : 
"http://172.22.119.57:8080/api/v1/clusters/cl1/requests/20/tasks/381";,
  "Tasks" : {
"attempt_cnt" : 1,
"cluster_name" : "cl1",
"command" : "START",
"command_detail" : "ZOOKEEPER_SERVER START",
"end_time" : 1484027166947,
"error_log" : "/var/lib/ambari-agent/data/errors-381.txt",
"exit_code" : 1,
"host_name" : "nat-d7-hxks-ambari-kerb-ad-2-4.openstacklocal",
"id" : 381,
"output_log" : "/var/lib/ambari-agent/data/output-381.txt",
"request_id" : 20,
"role" : "ZOOKEEPER_SERVER",
"stage_id" : 1,
"start_time" : 1484027164691,
"status" : "FAILED",
"st

Review Request 55629: Ranger Admin HA Wizard: next button disappears

2017-01-17 Thread Aleksandr Kovalenko

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55629/
---

Review request for Ambari and Andriy Babiichuk.


Bugs: AMBARI-19591
https://issues.apache.org/jira/browse/AMBARI-19591


Repository: ambari


Description
---

Next button disappears on step1 after typing valid URL to load balancer.


Diffs
-

  ambari-web/app/templates/main/admin/highAvailability/rangerAdmin/step1.hbs 
ed7098c 
  ambari-web/app/templates/main/admin/highAvailability/rangerAdmin/step3.hbs 
5342728 

Diff: https://reviews.apache.org/r/55629/diff/


Testing
---

20242 passing (25s)
  153 pending


Thanks,

Aleksandr Kovalenko



Re: Review Request 55622: Log Feeder should be able to handle metrics with https

2017-01-17 Thread Oliver Szabo

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55622/#review161884
---


Ship it!




Ship It!

- Oliver Szabo


On Jan. 17, 2017, 2:44 p.m., Miklos Gergely wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55622/
> ---
> 
> (Updated Jan. 17, 2017, 2:44 p.m.)
> 
> 
> Review request for Ambari, Oliver Szabo and Robert Nettleton.
> 
> 
> Bugs: AMBARI-19587
> https://issues.apache.org/jira/browse/AMBARI-19587
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Also fixed metrics handling in general as it had a bug.
> 
> 
> Diffs
> -
> 
>   
> ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/metrics/LogFeederAMSClient.java
>  2bdd7c9 
>   
> ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/util/SSLUtil.java
>  317f5ae 
>   
> ambari-server/src/main/java/org/apache/ambari/server/upgrade/UpgradeCatalog250.java
>  d19db3c 
>   
> ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/package/scripts/params.py
>  25e947d 
>   
> ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/properties/logfeeder-env.sh.j2
>  6d1c445 
>   
> ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/properties/logsearch-env.sh.j2
>  338c7f7 
>   
> ambari-server/src/test/java/org/apache/ambari/server/upgrade/UpgradeCatalog250Test.java
>  3c5b475 
>   ambari-server/src/test/python/stacks/2.4/LOGSEARCH/test_logfeeder.py 
> b172f64 
> 
> Diff: https://reviews.apache.org/r/55622/diff/
> 
> 
> Testing
> ---
> 
> Tested on local cluster
> 
> 
> Thanks,
> 
> Miklos Gergely
> 
>



Re: Review Request 55629: Ranger Admin HA Wizard: next button disappears

2017-01-17 Thread Andriy Babiichuk

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55629/#review161883
---


Ship it!




Ship It!

- Andriy Babiichuk


On Січ. 17, 2017, 4:36 після полудня, Aleksandr Kovalenko wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55629/
> ---
> 
> (Updated Січ. 17, 2017, 4:36 після полудня)
> 
> 
> Review request for Ambari and Andriy Babiichuk.
> 
> 
> Bugs: AMBARI-19591
> https://issues.apache.org/jira/browse/AMBARI-19591
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Next button disappears on step1 after typing valid URL to load balancer.
> 
> 
> Diffs
> -
> 
>   ambari-web/app/templates/main/admin/highAvailability/rangerAdmin/step1.hbs 
> ed7098c 
>   ambari-web/app/templates/main/admin/highAvailability/rangerAdmin/step3.hbs 
> 5342728 
> 
> Diff: https://reviews.apache.org/r/55629/diff/
> 
> 
> Testing
> ---
> 
> 20242 passing (25s)
>   153 pending
> 
> 
> Thanks,
> 
> Aleksandr Kovalenko
> 
>



Re: Review Request 55622: Log Feeder should be able to handle metrics with https

2017-01-17 Thread Miklos Gergely


> On Jan. 17, 2017, 3:57 p.m., Oliver Szabo wrote:
> > ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/package/scripts/params.py,
> >  line 356
> > 
> >
> > im not sure is that will be right behaviour, in case of metrics uses 
> > https, then we will need to setup keystores for every logfeeder on the 
> > cluster (because that is not auto generated), maybe its better approach, if 
> > the metrics publish is failing in case of ssl is not enabled for logfeeder 
> > and metrics uses that (or put a message about that in the logfeeder log. 
> > e.g.: we wont send metrics because logfeeder ssl is not configured)

just because logfeeder_use_ssl is true it doesn't mean that we must set up 
trust stores. If the path specified is not existing, than everything will be OK 
except that there are no metrics published, this variable only gives the 
opportunity to use the trust store specified if it is there


- Miklos


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55622/#review161878
---


On Jan. 17, 2017, 2:44 p.m., Miklos Gergely wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55622/
> ---
> 
> (Updated Jan. 17, 2017, 2:44 p.m.)
> 
> 
> Review request for Ambari, Oliver Szabo and Robert Nettleton.
> 
> 
> Bugs: AMBARI-19587
> https://issues.apache.org/jira/browse/AMBARI-19587
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Also fixed metrics handling in general as it had a bug.
> 
> 
> Diffs
> -
> 
>   
> ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/metrics/LogFeederAMSClient.java
>  2bdd7c9 
>   
> ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/util/SSLUtil.java
>  317f5ae 
>   
> ambari-server/src/main/java/org/apache/ambari/server/upgrade/UpgradeCatalog250.java
>  d19db3c 
>   
> ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/package/scripts/params.py
>  25e947d 
>   
> ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/properties/logfeeder-env.sh.j2
>  6d1c445 
>   
> ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/properties/logsearch-env.sh.j2
>  338c7f7 
>   
> ambari-server/src/test/java/org/apache/ambari/server/upgrade/UpgradeCatalog250Test.java
>  3c5b475 
>   ambari-server/src/test/python/stacks/2.4/LOGSEARCH/test_logfeeder.py 
> b172f64 
> 
> Diff: https://reviews.apache.org/r/55622/diff/
> 
> 
> Testing
> ---
> 
> Tested on local cluster
> 
> 
> Thanks,
> 
> Miklos Gergely
> 
>



Review Request 55627: Hive view 2.0 REST and backend support for enabling and fetching table and column stats

2017-01-17 Thread Nitiraj Rathore

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55627/
---

Review request for Ambari, DIPAYAN BHOWMICK, Gaurav Nagar, Pallav Kulshreshtha, 
and Rohit Choudhary.


Bugs: AMBARI-19584
https://issues.apache.org/jira/browse/AMBARI-19584


Repository: ambari


Description
---

Info can be found at : 
https://cwiki.apache.org/confluence/display/Hive/StatsDev#StatsDev-ColumnStatistics
Requirements:
1. REST endpoint to enable statistics for a table with support for stats for 
all columns -- done
2. REST endpoint to fetch table stats -- done : table stats will come with 
table info itself
3. REST endpoint to fetch column stats -- done


Diffs
-

  
contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/dto/ColumnInfo.java
 2876348 
  
contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/dto/ColumnStats.java
 PRE-CREATION 
  
contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/dto/TableMeta.java
 f47e76c 
  
contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/dto/TableStats.java
 PRE-CREATION 
  
contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/parsers/TableMetaParserImpl.java
 5cae34a 
  
contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/query/generators/AnalyzeTableQueryGenerator.java
 PRE-CREATION 
  
contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/internal/query/generators/FetchColumnStatsQueryGenerator.java
 PRE-CREATION 
  
contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/resources/browser/DDLProxy.java
 8d995dd 
  
contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/resources/browser/DDLService.java
 e142baf 
  
contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/resources/jobs/JobService.java
 675ea37 
  
contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/resources/jobs/ResultsPaginationController.java
 6efa2a9 
  
contrib/views/hive20/src/main/java/org/apache/ambari/view/hive20/resources/jobs/viewJobs/JobImpl.java
 85ffaf2 
  contrib/views/hive20/src/test/rest/postman/hive20.postman_collection.json 
d674944 

Diff: https://reviews.apache.org/r/55627/diff/


Testing
---

manual testing done.


Thanks,

Nitiraj Rathore



Re: Review Request 55622: Log Feeder should be able to handle metrics with https

2017-01-17 Thread Oliver Szabo

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55622/#review161878
---




ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/package/scripts/params.py
 (line 356)


im not sure is that will be right behaviour, in case of metrics uses https, 
then we will need to setup keystores for every logfeeder on the cluster 
(because that is not auto generated), maybe its better approach, if the metrics 
publish is failing in case of ssl is not enabled for logfeeder and metrics uses 
that (or put a message about that in the logfeeder log. e.g.: we wont send 
metrics because logfeeder ssl is not configured)


- Oliver Szabo


On Jan. 17, 2017, 2:44 p.m., Miklos Gergely wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55622/
> ---
> 
> (Updated Jan. 17, 2017, 2:44 p.m.)
> 
> 
> Review request for Ambari, Oliver Szabo and Robert Nettleton.
> 
> 
> Bugs: AMBARI-19587
> https://issues.apache.org/jira/browse/AMBARI-19587
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Also fixed metrics handling in general as it had a bug.
> 
> 
> Diffs
> -
> 
>   
> ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/metrics/LogFeederAMSClient.java
>  2bdd7c9 
>   
> ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/util/SSLUtil.java
>  317f5ae 
>   
> ambari-server/src/main/java/org/apache/ambari/server/upgrade/UpgradeCatalog250.java
>  d19db3c 
>   
> ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/package/scripts/params.py
>  25e947d 
>   
> ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/properties/logfeeder-env.sh.j2
>  6d1c445 
>   
> ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/properties/logsearch-env.sh.j2
>  338c7f7 
>   
> ambari-server/src/test/java/org/apache/ambari/server/upgrade/UpgradeCatalog250Test.java
>  3c5b475 
>   ambari-server/src/test/python/stacks/2.4/LOGSEARCH/test_logfeeder.py 
> b172f64 
> 
> Diff: https://reviews.apache.org/r/55622/diff/
> 
> 
> Testing
> ---
> 
> Tested on local cluster
> 
> 
> Thanks,
> 
> Miklos Gergely
> 
>



Re: Review Request 55597: Add upgrade logic for the heap dump control option added in HDP 2.6 stack.

2017-01-17 Thread Jonathan Hurley


> On Jan. 17, 2017, 9:47 a.m., Robert Levas wrote:
> > The implementation accounts only for adding content to a line-delimited 
> > string value.  Would there be a need to insert a value into a string with a 
> > different delimiater?  Maybe a comma (,)?

No, I don't think so. Consider this:
``

This will change
llap_java_opts=-Dfoo -Dbar
into
llap_java_opts=-Dfoo -Dbar {{heap_dump_opts}}

Doesn't require any line-delimiting.


> On Jan. 17, 2017, 9:47 a.m., Robert Levas wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java,
> >  lines 488-491
> > 
> >
> > Does it make sense to _prepend_ a value where the line separator comes 
> > before the value?  
> > 
> > ```
> > \nFOO + BAR\nBAZ = \nFOOBAR\nBAZ
> > ```
> > 
> > (Or maybe I am not interpreting this correctly)

Does it make sense? Perhaps not - but it's an option and if that's what is 
selected, then we'll do it. There may be a case for it depending on how 2 files 
might be merged together by some service. For example, if it combines two shell 
script templates into 1 - you might want that extra newline.


> On Jan. 17, 2017, 9:47 a.m., Robert Levas wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java,
> >  lines 493-496
> > 
> >
> > Does it make sense to _append_ a value where the line separator comes 
> > after the value?  
> > 
> > ```
> > BAR\nBAZ + FOO\n  = BAR\nBAZFOO\n
> > ```
> > 
> > (Or maybe I am not interpreting this correctly)

I definitely think it does - Git warns you if you don't have a trailing newline 
in new files. Also, some editors like vi might put the text too low, so 
developers like adding an extra newline :)


> On Jan. 17, 2017, 9:47 a.m., Robert Levas wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java,
> >  line 479
> > 
> >
> > `contains` seems to be a little relaxed here. What if we are inserting 
> > FOO into a value where FOOBAR exists.  FOO will not be inserted.

Relaxed, yes, but I think that's why this never made it into Ambari in previous 
versions. Because questions like this exposed a ton of weird edge cases. And 
then we end up without the ability to insert content at all.

This was meant as a first attempt to get the new properties in - I can open 
another Jira for tracking this since I don't see a good solution currently. 
Would that be sufficient?


- Jonathan


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55597/#review161868
---


On Jan. 16, 2017, 9:54 p.m., Jonathan Hurley wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55597/
> ---
> 
> (Updated Jan. 16, 2017, 9:54 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko, Nate Cole, and Robert Levas.
> 
> 
> Bugs: AMBARI-19574
> https://issues.apache.org/jira/browse/AMBARI-19574
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> There's a fuller description in the Jira issue, but just to sum up for easy 
> of reading:
> 
> - Hive added some properties in HDP 2.6
> - To upgrade these properties, existing content would need to be modified. 
> Unfortunately, find/replace isn't an option here
> - I created a very simple  directive to prepend/append properties
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java
>  97280ee 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigUpgradeChangeDefinition.java
>  5428ea7 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigureTask.java
>  d7bb338 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml 
> 40052d8 
>   
> ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.6.xml
>  09608a0 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.6.xml 
> 949a174 
>   ambari-server/src/main/resources/upgrade-config.xsd e274451 
>   
> ambari-server/src/test/java/org/apache/ambari/server/serveraction/upgrades/ConfigureActionTest.java
>  92fa084 
> 
> Diff: https://reviews.apache.org/r/55597/diff/
> 
> 
> Testing
> ---
> 
> Tests run: 4857, Failures: 0, Errors: 0, Skipped: 38
> 
> [INFO] 
> 
> [INFO] BUILD SUCCESS
> [INFO] 
> ---

Re: Review Request 55617: AMBARI-19585. Client config tags may not be saved by agent

2017-01-17 Thread Sebastian Toader

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55617/#review161872
---


Ship it!




Ship It!

- Sebastian Toader


On Jan. 17, 2017, 2:28 p.m., Attila Doroszlai wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55617/
> ---
> 
> (Updated Jan. 17, 2017, 2:28 p.m.)
> 
> 
> Review request for Ambari, Andrew Onischuk, Sandor Magyari, and Sebastian 
> Toader.
> 
> 
> Bugs: AMBARI-19585
> https://issues.apache.org/jira/browse/AMBARI-19585
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Fetch service/component map before executing first command, too, do not wait 
> until first status command.
> 
> 
> Diffs
> -
> 
>   ambari-agent/src/main/python/ambari_agent/Controller.py 
> d00ffae50e01821edf8ec2c9ac2f4c9ca0e4986d 
>   ambari-agent/src/test/python/ambari_agent/TestActionQueue.py 
> d4f543617b1f511e68a371b346760f330c40f04e 
>   ambari-agent/src/test/python/ambari_agent/TestController.py 
> b47af0369a471c37e82e802e6e1d953031cac82d 
> 
> Diff: https://reviews.apache.org/r/55617/diff/
> 
> 
> Testing
> ---
> 
> Manual testing:
>  * create cluster via blueprint
>  * verify `*_config.json` is created for client components whose installation 
> finished before the first status command (FALCON_CLIENT and HBASE_CLIENT 
> below)
> 
> ```
> $ grep 'Adding.*command\|Executing command.*CLIENT' 
> /var/log/ambari-agent/ambari-agent.log
> INFO 2017-01-17 13:00:42,495 Controller.py:248 - Adding 39 commands. 
> Heartbeat id = 15
> INFO 2017-01-17 13:00:53,138 ActionQueue.py:273 - Executing command with id = 
> 4-0, taskId = 5 for role = FALCON_CLIENT of cluster TEST.
> INFO 2017-01-17 13:00:55,174 ActionQueue.py:273 - Executing command with id = 
> 4-0, taskId = 7 for role = HBASE_CLIENT of cluster TEST.
> INFO 2017-01-17 13:01:32,992 Controller.py:257 - Adding 8 status commands. 
> Heartbeat id = 69
> INFO 2017-01-17 13:01:51,245 ActionQueue.py:273 - Executing command with id = 
> 4-0, taskId = 11 for role = HDFS_CLIENT of cluster TEST.
> INFO 2017-01-17 13:01:53,232 ActionQueue.py:273 - Executing command with id = 
> 4-0, taskId = 13 for role = HIVE_CLIENT of cluster TEST.
> ...
> $ ls -l --full-time /var/lib/ambari-agent/data/*_CLIENT_config*
> -rw-r--r-- 1 root root 6327 2017-01-17 13:00:54.167877626 + 
> /var/lib/ambari-agent/data/FALCON_CLIENT_config.json
> -rw-r--r-- 1 root root 6327 2017-01-17 13:00:56.496747403 + 
> /var/lib/ambari-agent/data/HBASE_CLIENT_config.json
> -rw-r--r-- 1 root root 6327 2017-01-17 13:01:52.317955884 + 
> /var/lib/ambari-agent/data/HDFS_CLIENT_config.json
> -rw-r--r-- 1 root root 6327 2017-01-17 13:01:54.465860199 + 
> /var/lib/ambari-agent/data/HIVE_CLIENT_config.json
> ```
> 
> Unit tests:
> 
> ```
> $ mvn -pl ambari-agent -DskipSurefireTests test
> ...
> Ran 453 tests in 13.271s
> 
> OK
> ...
> [INFO] Rat check: Summary of files. Unapproved: 0 unknown: 0 generated: 0 
> approved: 156 licence.
> [INFO] 
> 
> [INFO] BUILD SUCCESS
> ```
> 
> 
> Thanks,
> 
> Attila Doroszlai
> 
>



Review Request 55622: Log Feeder should be able to handle metrics with https

2017-01-17 Thread Miklos Gergely

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55622/
---

Review request for Ambari, Oliver Szabo and Robert Nettleton.


Bugs: AMBARI-19587
https://issues.apache.org/jira/browse/AMBARI-19587


Repository: ambari


Description
---

Also fixed metrics handling in general as it had a bug.


Diffs
-

  
ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/metrics/LogFeederAMSClient.java
 2bdd7c9 
  
ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/util/SSLUtil.java
 317f5ae 
  
ambari-server/src/main/java/org/apache/ambari/server/upgrade/UpgradeCatalog250.java
 d19db3c 
  
ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/package/scripts/params.py
 25e947d 
  
ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/properties/logfeeder-env.sh.j2
 6d1c445 
  
ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/properties/logsearch-env.sh.j2
 338c7f7 
  
ambari-server/src/test/java/org/apache/ambari/server/upgrade/UpgradeCatalog250Test.java
 3c5b475 
  ambari-server/src/test/python/stacks/2.4/LOGSEARCH/test_logfeeder.py b172f64 

Diff: https://reviews.apache.org/r/55622/diff/


Testing
---

Tested on local cluster


Thanks,

Miklos Gergely



Re: Review Request 55597: Add upgrade logic for the heap dump control option added in HDP 2.6 stack.

2017-01-17 Thread Robert Levas

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55597/#review161868
---


Fix it, then Ship it!




The implementation accounts only for adding content to a line-delimited string 
value.  Would there be a need to insert a value into a string with a different 
delimiater?  Maybe a comma (,)?


ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java
 (line 476)


`contains` seems to be a little relaxed here. What if we are inserting FOO 
into a value where FOOBAR exists.  FOO will not be inserted.



ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java
 (lines 485 - 488)


Does it make sense to _prepend_ a value where the line separator comes 
before the value?  

```
\nFOO + BAR\nBAZ = \nFOOBAR\nBAZ
```

(Or maybe I am not interpreting this correctly)



ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java
 (lines 490 - 493)


Does it make sense to _append_ a value where the line separator comes after 
the value?  

```
BAR\nBAZ + FOO\n  = BAR\nBAZFOO\n
```

(Or maybe I am not interpreting this correctly)


- Robert Levas


On Jan. 16, 2017, 9:54 p.m., Jonathan Hurley wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55597/
> ---
> 
> (Updated Jan. 16, 2017, 9:54 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko, Nate Cole, and Robert Levas.
> 
> 
> Bugs: AMBARI-19574
> https://issues.apache.org/jira/browse/AMBARI-19574
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> There's a fuller description in the Jira issue, but just to sum up for easy 
> of reading:
> 
> - Hive added some properties in HDP 2.6
> - To upgrade these properties, existing content would need to be modified. 
> Unfortunately, find/replace isn't an option here
> - I created a very simple  directive to prepend/append properties
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/serveraction/upgrades/ConfigureAction.java
>  97280ee 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigUpgradeChangeDefinition.java
>  5428ea7 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/stack/upgrade/ConfigureTask.java
>  d7bb338 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml 
> 40052d8 
>   
> ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.6.xml
>  09608a0 
>   ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.6.xml 
> 949a174 
>   ambari-server/src/main/resources/upgrade-config.xsd e274451 
>   
> ambari-server/src/test/java/org/apache/ambari/server/serveraction/upgrades/ConfigureActionTest.java
>  92fa084 
> 
> Diff: https://reviews.apache.org/r/55597/diff/
> 
> 
> Testing
> ---
> 
> Tests run: 4857, Failures: 0, Errors: 0, Skipped: 38
> 
> [INFO] 
> 
> [INFO] BUILD SUCCESS
> [INFO] 
> 
> [INFO] Total time: 26:49 min
> [INFO] Finished at: 2017-01-16T20:53:37-05:00
> [INFO] Final Memory: 55M/708M
> [INFO] 
> 
> 
> 
> Thanks,
> 
> Jonathan Hurley
> 
>



Re: Review Request 53213: Exporting blueprint from kerberos enabled cluster, exports hardcoded values cluster name and realm in principal_name property

2017-01-17 Thread Robert Levas

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53213/#review161866
---


Ship it!




Ship It!

- Robert Levas


On Jan. 11, 2017, 7:33 p.m., Amruta Borkar wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/53213/
> ---
> 
> (Updated Jan. 11, 2017, 7:33 p.m.)
> 
> 
> Review request for Ambari, Di Li, Jaimin Jetly, Jayush Luniya, Robert Levas, 
> and Robert Nettleton.
> 
> 
> Bugs: AMBARI-18692
> https://issues.apache.org/jira/browse/AMBARI-18692
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Exporting blueprint from kerberos enabled cluster, exports hardcoded values 
> cluster name and realm in principal_name property.
> When the same blueprint is used to create another cluster with different 
> name, service start fail with following error:
> "resource_management.core.exceptions.Fail: Execution of '/usr/bin/kinit -kt 
> /etc/security/keytabs/hdfs.headless.keytab [keytab_name_in_blueprint] eturned 
> 1. kinit: Keytab contains no suitable keys for [keytab_name_in_blueprint] 
> while getting initial credentials"
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/internal/BlueprintConfigurationProcessor.java
>  737e8de 
>   
> ambari-server/src/main/java/org/apache/ambari/server/controller/internal/Stack.java
>  16f75ee 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/PropertyInfo.java 
> 01c8a89 
>   
> ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/configuration/accumulo-env.xml
>  1d330dd 
>   
> ambari-server/src/main/resources/common-services/AMBARI_INFRA/0.1.0/configuration/infra-solr-env.xml
>  d7ae236 
>   
> ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/configuration/ams-hbase-security-site.xml
>  2be101b 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/configuration/application-properties.xml
>  9efa4f9 
>   
> ambari-server/src/main/resources/common-services/DRUID/0.9.2/configuration/druid-common.xml
>  0ded5d6 
>   
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/configuration/hbase-env.xml
>  2ab6aa0 
>   
> ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/configuration/hadoop-env.xml
>  c2f37c1 
>   
> ambari-server/src/main/resources/common-services/KAFKA/0.8.1/configuration/kafka-env.xml
>  e8a76b6 
>   
> ambari-server/src/main/resources/common-services/KERBEROS/1.10.3-10/configuration/kerberos-env.xml
>  7016437 
>   
> ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/configuration/knox-env.xml
>  2e5a026 
>   
> ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/configuration/logfeeder-env.xml
>  fb641a8 
>   
> ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/configuration/logsearch-env.xml
>  a6f1502 
>   
> ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/configuration/logsearch-properties.xml
>  47872ee 
>   
> ambari-server/src/main/resources/common-services/RANGER/0.6.0/configuration/ranger-admin-site.xml
>  36ebc8c 
>   
> ambari-server/src/main/resources/common-services/RANGER/0.6.0/configuration/ranger-tagsync-site.xml
>  a0bd322 
>   
> ambari-server/src/main/resources/common-services/RANGER/0.6.0/configuration/ranger-ugsync-site.xml
>  d267b75 
>   
> ambari-server/src/main/resources/common-services/RANGER_KMS/0.5.0.2.3/configuration/kms-site.xml
>  1bce4e6 
>   
> ambari-server/src/main/resources/common-services/SPARK/1.2.1/configuration/spark-defaults.xml
>  b85cf50 
>   
> ambari-server/src/main/resources/common-services/SPARK/1.2.1/configuration/spark-env.xml
>  71a42f7 
>   
> ambari-server/src/main/resources/common-services/SPARK2/2.0.0/configuration/spark2-defaults.xml
>  a5115af 
>   
> ambari-server/src/main/resources/common-services/SPARK2/2.0.0/configuration/spark2-env.xml
>  b78fd79 
>   
> ambari-server/src/main/resources/common-services/STORM/0.9.1/configuration/storm-env.xml
>  5d0b2ff 
>   
> ambari-server/src/main/resources/common-services/ZEPPELIN/0.6.0.2.5/configuration/zeppelin-env.xml
>  e6c59d5 
>   
> ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5/configuration/zookeeper-env.xml
>  696b28a 
>   ambari-server/src/main/resources/configuration-schema.xsd daba29f 
> 
> Diff: https://reviews.apache.org/r/53213/diff/
> 
> 
> Testing
> ---
> 
> Tested manually. Suitable keytabs are generated automatically when not 
> mentioned in blueprint. Service starts succeeded with a blueprint exported 
> with the code change. 
> Modified existing unit test cases.
> 
> 
> Thanks,
> 
> Amruta Borkar
> 
>



Re: Review Request 55618: Ranger Admin HA Wizard should display configs changes explicitly

2017-01-17 Thread Oleg Nechiporenko

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55618/#review161862
---


Ship it!




Ship It!

- Oleg Nechiporenko


On Jan. 17, 2017, 1:48 p.m., Andriy Babiichuk wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55618/
> ---
> 
> (Updated Jan. 17, 2017, 1:48 p.m.)
> 
> 
> Review request for Ambari and Oleg Nechiporenko.
> 
> 
> Bugs: AMBARI-19586
> https://issues.apache.org/jira/browse/AMBARI-19586
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Configs changes in Ranger Admin HA Wizard aren't shown explicitly (just the 
> message mentioning the affected property is displayed instead).
> 
> 
> Diffs
> -
> 
>   ambari-web/app/assets/test/tests.js 604d96b 
>   
> ambari-web/app/controllers/main/admin/highAvailability/rangerAdmin/step3_controller.js
>  475cc52 
>   
> ambari-web/app/controllers/main/admin/highAvailability/rangerAdmin/step4_controller.js
>  b7818d9 
>   
> ambari-web/app/controllers/main/admin/highAvailability/rangerAdmin/wizard_controller.js
>  2bc6e37 
>   ambari-web/app/routes/ra_high_availability_routes.js ac975ab 
>   ambari-web/app/templates/main/admin/highAvailability/rangerAdmin/step3.hbs 
> 3c798c8 
>   ambari-web/app/views/main/admin/highAvailability/rangerAdmin/step3_view.js 
> 8aa0125 
>   
> ambari-web/test/controllers/main/admin/highAvailability/rangerAdmin/step3_controller_test.js
>  PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/55618/diff/
> 
> 
> Testing
> ---
> 
> 20395 tests complete (39 seconds)
>   153 tests pending
> 
> 
> Thanks,
> 
> Andriy Babiichuk
> 
>



Review Request 55618: Ranger Admin HA Wizard should display configs changes explicitly

2017-01-17 Thread Andriy Babiichuk

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55618/
---

Review request for Ambari and Oleg Nechiporenko.


Bugs: AMBARI-19586
https://issues.apache.org/jira/browse/AMBARI-19586


Repository: ambari


Description
---

Configs changes in Ranger Admin HA Wizard aren't shown explicitly (just the 
message mentioning the affected property is displayed instead).


Diffs
-

  ambari-web/app/assets/test/tests.js 604d96b 
  
ambari-web/app/controllers/main/admin/highAvailability/rangerAdmin/step3_controller.js
 475cc52 
  
ambari-web/app/controllers/main/admin/highAvailability/rangerAdmin/step4_controller.js
 b7818d9 
  
ambari-web/app/controllers/main/admin/highAvailability/rangerAdmin/wizard_controller.js
 2bc6e37 
  ambari-web/app/routes/ra_high_availability_routes.js ac975ab 
  ambari-web/app/templates/main/admin/highAvailability/rangerAdmin/step3.hbs 
3c798c8 
  ambari-web/app/views/main/admin/highAvailability/rangerAdmin/step3_view.js 
8aa0125 
  
ambari-web/test/controllers/main/admin/highAvailability/rangerAdmin/step3_controller_test.js
 PRE-CREATION 

Diff: https://reviews.apache.org/r/55618/diff/


Testing
---

20395 tests complete (39 seconds)
  153 tests pending


Thanks,

Andriy Babiichuk



Review Request 55617: AMBARI-19585. Client config tags may not be saved by agent

2017-01-17 Thread Attila Doroszlai

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55617/
---

Review request for Ambari, Andrew Onischuk, Sandor Magyari, and Sebastian 
Toader.


Bugs: AMBARI-19585
https://issues.apache.org/jira/browse/AMBARI-19585


Repository: ambari


Description
---

Fetch service/component map before executing first command, too, do not wait 
until first status command.


Diffs
-

  ambari-agent/src/main/python/ambari_agent/Controller.py 
d00ffae50e01821edf8ec2c9ac2f4c9ca0e4986d 
  ambari-agent/src/test/python/ambari_agent/TestActionQueue.py 
d4f543617b1f511e68a371b346760f330c40f04e 
  ambari-agent/src/test/python/ambari_agent/TestController.py 
b47af0369a471c37e82e802e6e1d953031cac82d 

Diff: https://reviews.apache.org/r/55617/diff/


Testing
---

Manual testing:
 * create cluster via blueprint
 * verify `*_config.json` is created for client components whose installation 
finished before the first status command (FALCON_CLIENT and HBASE_CLIENT below)

```
$ grep 'Adding.*command\|Executing command.*CLIENT' 
/var/log/ambari-agent/ambari-agent.log
INFO 2017-01-17 13:00:42,495 Controller.py:248 - Adding 39 commands. Heartbeat 
id = 15
INFO 2017-01-17 13:00:53,138 ActionQueue.py:273 - Executing command with id = 
4-0, taskId = 5 for role = FALCON_CLIENT of cluster TEST.
INFO 2017-01-17 13:00:55,174 ActionQueue.py:273 - Executing command with id = 
4-0, taskId = 7 for role = HBASE_CLIENT of cluster TEST.
INFO 2017-01-17 13:01:32,992 Controller.py:257 - Adding 8 status commands. 
Heartbeat id = 69
INFO 2017-01-17 13:01:51,245 ActionQueue.py:273 - Executing command with id = 
4-0, taskId = 11 for role = HDFS_CLIENT of cluster TEST.
INFO 2017-01-17 13:01:53,232 ActionQueue.py:273 - Executing command with id = 
4-0, taskId = 13 for role = HIVE_CLIENT of cluster TEST.
...
$ ls -l --full-time /var/lib/ambari-agent/data/*_CLIENT_config*
-rw-r--r-- 1 root root 6327 2017-01-17 13:00:54.167877626 + 
/var/lib/ambari-agent/data/FALCON_CLIENT_config.json
-rw-r--r-- 1 root root 6327 2017-01-17 13:00:56.496747403 + 
/var/lib/ambari-agent/data/HBASE_CLIENT_config.json
-rw-r--r-- 1 root root 6327 2017-01-17 13:01:52.317955884 + 
/var/lib/ambari-agent/data/HDFS_CLIENT_config.json
-rw-r--r-- 1 root root 6327 2017-01-17 13:01:54.465860199 + 
/var/lib/ambari-agent/data/HIVE_CLIENT_config.json
```

Unit tests:

```
$ mvn -pl ambari-agent -DskipSurefireTests test
...
Ran 453 tests in 13.271s

OK
...
[INFO] Rat check: Summary of files. Unapproved: 0 unknown: 0 generated: 0 
approved: 156 licence.
[INFO] 
[INFO] BUILD SUCCESS
```


Thanks,

Attila Doroszlai



Re: Review Request 55614: AMBARI-19581. Need to show proper error message in scenarios of failures with asset import

2017-01-17 Thread Nitiraj Rathore

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55614/#review161856
---


Ship it!




Ship It!

- Nitiraj Rathore


On Jan. 17, 2017, 12:02 p.m., Madhan Reddy wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55614/
> ---
> 
> (Updated Jan. 17, 2017, 12:02 p.m.)
> 
> 
> Review request for Ambari, belliraj hb, DIPAYAN BHOWMICK, Gaurav Nagar, 
> Nitiraj Rathore, and Pallav Kulshreshtha.
> 
> 
> Bugs: AMBARI-19581
> https://issues.apache.org/jira/browse/AMBARI-19581
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Need to show proper error message in scenarios of failures with asset import.
> While importing the asset for a given action node, its better to show only 
> assets belonging to that particular type.
> Steps to reproduce :
> 1) Save hive node settings as an asset.
> 2) Now try to import that setting for hive2 or node other than hive.
> 3) user is shown with the message 'Invalid asset settings'. 
> Either user should be shown only the assets of that particular type or 
> appropriate error message should be displayed as why import setting has 
> failed.
> 
> 
> Diffs
> -
> 
>   contrib/views/wfmanager/src/main/resources/ui/app/components/asset-list.js 
> 2ea82b0 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/components/flow-designer.js 
> d0c05d6 
>   contrib/views/wfmanager/src/main/resources/ui/app/styles/app.less bc0e419 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/asset-config.hbs
>  4ee6d05 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/asset-list.hbs
>  d377d2c 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/asset-manager.hbs
>  0fa86b0 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/flow-designer.hbs
>  80af968 
> 
> Diff: https://reviews.apache.org/r/55614/diff/
> 
> 
> Testing
> ---
> 
> Manual
> 
> 
> Thanks,
> 
> Madhan Reddy
> 
>



Re: Review Request 55614: AMBARI-19581. Need to show proper error message in scenarios of failures with asset import

2017-01-17 Thread belliraj hb

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55614/#review161855
---


Ship it!




Ship It!

- belliraj hb


On Jan. 17, 2017, 12:02 p.m., Madhan Reddy wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55614/
> ---
> 
> (Updated Jan. 17, 2017, 12:02 p.m.)
> 
> 
> Review request for Ambari, belliraj hb, DIPAYAN BHOWMICK, Gaurav Nagar, 
> Nitiraj Rathore, and Pallav Kulshreshtha.
> 
> 
> Bugs: AMBARI-19581
> https://issues.apache.org/jira/browse/AMBARI-19581
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Need to show proper error message in scenarios of failures with asset import.
> While importing the asset for a given action node, its better to show only 
> assets belonging to that particular type.
> Steps to reproduce :
> 1) Save hive node settings as an asset.
> 2) Now try to import that setting for hive2 or node other than hive.
> 3) user is shown with the message 'Invalid asset settings'. 
> Either user should be shown only the assets of that particular type or 
> appropriate error message should be displayed as why import setting has 
> failed.
> 
> 
> Diffs
> -
> 
>   contrib/views/wfmanager/src/main/resources/ui/app/components/asset-list.js 
> 2ea82b0 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/components/flow-designer.js 
> d0c05d6 
>   contrib/views/wfmanager/src/main/resources/ui/app/styles/app.less bc0e419 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/asset-config.hbs
>  4ee6d05 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/asset-list.hbs
>  d377d2c 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/asset-manager.hbs
>  0fa86b0 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/flow-designer.hbs
>  80af968 
> 
> Diff: https://reviews.apache.org/r/55614/diff/
> 
> 
> Testing
> ---
> 
> Manual
> 
> 
> Thanks,
> 
> Madhan Reddy
> 
>



Review Request 55615: Hive View 2.0: Show query logs

2017-01-17 Thread Pallav Kulshreshtha

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55615/
---

Review request for Ambari, DIPAYAN BHOWMICK, Gaurav Nagar, Nitiraj Rathore, and 
Rohit Choudhary.


Bugs: AMBARI-19582
https://issues.apache.org/jira/browse/AMBARI-19582


Repository: ambari


Description
---

UI changes for showing the logs and query results in separate tabs.


Diffs
-

  contrib/views/hive20/src/main/resources/ui/app/adapters/query.js a666b09 
  contrib/views/hive20/src/main/resources/ui/app/components/query-result-log.js 
PRE-CREATION 
  contrib/views/hive20/src/main/resources/ui/app/models/worksheet.js 59395e6 
  contrib/views/hive20/src/main/resources/ui/app/routes/queries/query.js 
606b71a 
  contrib/views/hive20/src/main/resources/ui/app/services/jobs.js 723953c 
  contrib/views/hive20/src/main/resources/ui/app/services/query.js 400f78b 
  
contrib/views/hive20/src/main/resources/ui/app/templates/components/query-result-log.hbs
 PRE-CREATION 
  contrib/views/hive20/src/main/resources/ui/app/templates/queries/query.hbs 
2138356 

Diff: https://reviews.apache.org/r/55615/diff/


Testing
---

manually tested.


Thanks,

Pallav Kulshreshtha



Review Request 55614: AMBARI-19581. Need to show proper error message in scenarios of failures with asset import

2017-01-17 Thread Madhan Reddy

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55614/
---

Review request for Ambari, DIPAYAN BHOWMICK, Gaurav Nagar, Nitiraj Rathore, and 
Pallav Kulshreshtha.


Bugs: AMBARI-19581
https://issues.apache.org/jira/browse/AMBARI-19581


Repository: ambari


Description
---

Need to show proper error message in scenarios of failures with asset import.
While importing the asset for a given action node, its better to show only 
assets belonging to that particular type.
Steps to reproduce :
1) Save hive node settings as an asset.
2) Now try to import that setting for hive2 or node other than hive.
3) user is shown with the message 'Invalid asset settings'. 
Either user should be shown only the assets of that particular type or 
appropriate error message should be displayed as why import setting has failed.


Diffs
-

  contrib/views/wfmanager/src/main/resources/ui/app/components/asset-list.js 
2ea82b0 
  contrib/views/wfmanager/src/main/resources/ui/app/components/flow-designer.js 
d0c05d6 
  contrib/views/wfmanager/src/main/resources/ui/app/styles/app.less bc0e419 
  
contrib/views/wfmanager/src/main/resources/ui/app/templates/components/asset-config.hbs
 4ee6d05 
  
contrib/views/wfmanager/src/main/resources/ui/app/templates/components/asset-list.hbs
 d377d2c 
  
contrib/views/wfmanager/src/main/resources/ui/app/templates/components/asset-manager.hbs
 0fa86b0 
  
contrib/views/wfmanager/src/main/resources/ui/app/templates/components/flow-designer.hbs
 80af968 

Diff: https://reviews.apache.org/r/55614/diff/


Testing
---

Manual


Thanks,

Madhan Reddy



Re: Review Request 55610: AMBARI-19580: Organize tabs in job details page

2017-01-17 Thread Gaurav Nagar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55610/#review161852
---


Ship it!




Ship It!

- Gaurav Nagar


On Jan. 17, 2017, 10:45 a.m., Padma Priya N wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55610/
> ---
> 
> (Updated Jan. 17, 2017, 10:45 a.m.)
> 
> 
> Review request for Ambari, belliraj hb, Gaurav Nagar, and Pallav Kulshreshtha.
> 
> 
> Bugs: AMBARI-19580
> https://issues.apache.org/jira/browse/AMBARI-19580
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> The tabs should be reordered in job details page in such a way that flow grap 
> come first and static values like definition and configuration goes to the 
> end.
> 
> 
> Diffs
> -
> 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/job-details.hbs
>  97d4133 
> 
> Diff: https://reviews.apache.org/r/55610/diff/
> 
> 
> Testing
> ---
> 
> Manual Testing
> 
> 
> Thanks,
> 
> Padma Priya N
> 
>



Re: Review Request 55573: Hive View 2.0: Export Query Result

2017-01-17 Thread Gaurav Nagar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55573/#review161851
---


Ship it!




Ship It!

- Gaurav Nagar


On Jan. 16, 2017, 12:39 p.m., Pallav Kulshreshtha wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55573/
> ---
> 
> (Updated Jan. 16, 2017, 12:39 p.m.)
> 
> 
> Review request for Ambari, DIPAYAN BHOWMICK, Gaurav Nagar, Nitiraj Rathore, 
> and Rohit Choudhary.
> 
> 
> Bugs: AMBARI-19566
> https://issues.apache.org/jira/browse/AMBARI-19566
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Added save as HDFS and download As Csv feature.
> 
> 
> Diffs
> -
> 
>   contrib/views/hive20/src/main/resources/ui/app/adapters/job.js e2f342e 
>   contrib/views/hive20/src/main/resources/ui/app/components/export-result.js 
> PRE-CREATION 
>   
> contrib/views/hive20/src/main/resources/ui/app/components/query-result-table.js
>  429dfb3 
>   contrib/views/hive20/src/main/resources/ui/app/components/save-hdfs.js 
> 05b3b33 
>   contrib/views/hive20/src/main/resources/ui/app/routes/queries/query.js 
> d4c82fa 
>   contrib/views/hive20/src/main/resources/ui/app/services/query.js d95a2e5 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/export-result.hbs
>  PRE-CREATION 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/query-result-table.hbs
>  4bda978 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/save-hdfs.hbs
>  5b53102 
>   contrib/views/hive20/src/main/resources/ui/app/templates/queries/query.hbs 
> 120a045 
> 
> Diff: https://reviews.apache.org/r/55573/diff/
> 
> 
> Testing
> ---
> 
> manually tested.
> 
> 
> Thanks,
> 
> Pallav Kulshreshtha
> 
>



Re: Review Request 55610: AMBARI-19580: Organize tabs in job details page

2017-01-17 Thread belliraj hb

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55610/#review161850
---


Ship it!




Ship It!

- belliraj hb


On Jan. 17, 2017, 10:45 a.m., Padma Priya N wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55610/
> ---
> 
> (Updated Jan. 17, 2017, 10:45 a.m.)
> 
> 
> Review request for Ambari, belliraj hb, Gaurav Nagar, and Pallav Kulshreshtha.
> 
> 
> Bugs: AMBARI-19580
> https://issues.apache.org/jira/browse/AMBARI-19580
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> The tabs should be reordered in job details page in such a way that flow grap 
> come first and static values like definition and configuration goes to the 
> end.
> 
> 
> Diffs
> -
> 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/job-details.hbs
>  97d4133 
> 
> Diff: https://reviews.apache.org/r/55610/diff/
> 
> 
> Testing
> ---
> 
> Manual Testing
> 
> 
> Thanks,
> 
> Padma Priya N
> 
>



Review Request 55610: AMBARI-19580: Organize tabs in job details page

2017-01-17 Thread Padma Priya N

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55610/
---

Review request for Ambari, belliraj hb, Gaurav Nagar, and Pallav Kulshreshtha.


Bugs: AMBARI-19580
https://issues.apache.org/jira/browse/AMBARI-19580


Repository: ambari


Description
---

The tabs should be reordered in job details page in such a way that flow grap 
come first and static values like definition and configuration goes to the end.


Diffs
-

  
contrib/views/wfmanager/src/main/resources/ui/app/templates/components/job-details.hbs
 97d4133 

Diff: https://reviews.apache.org/r/55610/diff/


Testing
---

Manual Testing


Thanks,

Padma Priya N



Re: Review Request 55556: ranger_usersync should install with ranger_admin in the same host

2017-01-17 Thread alice zhangxiaolu


> On 一月 16, 2017, 7:05 p.m., Alejandro Fernandez wrote:
> > ambari-web/app/models/stack_service_component.js, line 200
> > 
> >
> > Can this come from metainfo instead of being hardcoded on the UI?
> > 
> > Please add Jaimin Jetly for input.
> 
> alice zhangxiaolu wrote:
> As we all know, there are two ways installing relative components in same 
> host;
> 
> (1)fisrt method is as above, configs relative components in 
> stack_service_component.js.
> (2)second method is in metainfo,but cannot be shown in web. The method is 
> as follows:
> 
> 
>   true
>   RANGER/RANGER_ADMIN
> 
> 
> so suggest we can select one.
> thanks for your reply.

Please ignore my above reply : )


Thanks for your reply.
As I know, there are two ways making one component install with other in same 
host automaticlly

The first one is to code in stack_service_component.js as I did in my patch.
The second one is to add following configuration to section  RANGER_ADMIN 
component in metainfo.xml:
   
  true
  RANGER/RANGER_USERSYNC
   

The advantage of firs way is that we can see the relation in web page clearly  
which the second one lacks


- alice


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/6/#review161773
---


On 一月 17, 2017, 2:12 a.m., alice alice wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/6/
> ---
> 
> (Updated 一月 17, 2017, 2:12 a.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Jaimin Jetly, Jayush Luniya, 
> Zhe (Joe) Wang, Richard Zang, Sumit Mohanty, Sid Wagle, and Yusaku Sako.
> 
> 
> Bugs: AMBARI-19557
> https://issues.apache.org/jira/browse/AMBARI-19557
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_Ranger_Install_Guide/content/ch03s01.html??
> The Ranger Admin and Ranger Usersync services must be installed on the same 
> cluster node.
> so we'd betted install ranger_admin and ranger_usersync in same cluster node 
> in instaling at managing master hostcomponent
> 
> 
> Diffs
> -
> 
>   ambari-web/app/models/stack_service_component.js 17c2aa1 
> 
> Diff: https://reviews.apache.org/r/6/diff/
> 
> 
> Testing
> ---
> 
> done it
> 
> 
> Thanks,
> 
> alice alice
> 
>



Re: Review Request 55555: Ambari Yarn Queue Manager allows two same queue name

2017-01-17 Thread Gaurav Nagar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/5/#review161842
---


Ship it!




Ship It!

- Gaurav Nagar


On Jan. 16, 2017, 6:35 a.m., Akhil PB wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/5/
> ---
> 
> (Updated Jan. 16, 2017, 6:35 a.m.)
> 
> 
> Review request for Ambari, DIPAYAN BHOWMICK, Gaurav Nagar, Pallav 
> Kulshreshtha, and Sreenath Somarajapuram.
> 
> 
> Bugs: AMBARI-19556
> https://issues.apache.org/jira/browse/AMBARI-19556
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> This patch fixes the RM exception thrown for RM restart because of duplicate 
> queue names.
> 
> 
> Diffs
> -
> 
>   
> contrib/views/capacity-scheduler/src/main/resources/ui/app/components/pathInput.js
>  e71d226 
> 
> Diff: https://reviews.apache.org/r/5/diff/
> 
> 
> Testing
> ---
> 
> Manual unit testing
> 
> 
> Thanks,
> 
> Akhil PB
> 
>



Review Request 55609: Add Livy session recovery configurations in Ambari

2017-01-17 Thread Saisai Shao

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55609/
---

Review request for Ambari and Sumit Mohanty.


Bugs: AMBARI-19577
https://issues.apache.org/jira/browse/AMBARI-19577


Repository: ambari


Description
---

Add Livy session recovery configurations in Ambari


Diffs
-

  
ambari-server/src/main/resources/stacks/HDP/2.6/services/SPARK/configuration/livy-conf.xml
 b7bfa73 
  
ambari-server/src/main/resources/stacks/HDP/2.6/services/SPARK2/configuration/livy2-conf.xml
 457869d 

Diff: https://reviews.apache.org/r/55609/diff/


Testing
---

Manual verification.


Thanks,

Saisai Shao



Re: Review Request 55555: Ambari Yarn Queue Manager allows two same queue name

2017-01-17 Thread Sreenath Somarajapuram

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/5/#review161841
---


Ship it!




Ship It!

- Sreenath Somarajapuram


On Jan. 16, 2017, 6:35 a.m., Akhil PB wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/5/
> ---
> 
> (Updated Jan. 16, 2017, 6:35 a.m.)
> 
> 
> Review request for Ambari, DIPAYAN BHOWMICK, Gaurav Nagar, Pallav 
> Kulshreshtha, and Sreenath Somarajapuram.
> 
> 
> Bugs: AMBARI-19556
> https://issues.apache.org/jira/browse/AMBARI-19556
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> This patch fixes the RM exception thrown for RM restart because of duplicate 
> queue names.
> 
> 
> Diffs
> -
> 
>   
> contrib/views/capacity-scheduler/src/main/resources/ui/app/components/pathInput.js
>  e71d226 
> 
> Diff: https://reviews.apache.org/r/5/diff/
> 
> 
> Testing
> ---
> 
> Manual unit testing
> 
> 
> Thanks,
> 
> Akhil PB
> 
>



Re: Review Request 55556: ranger_usersync should install with ranger_admin in the same host

2017-01-17 Thread alice zhangxiaolu


> On 一月 16, 2017, 7:05 p.m., Alejandro Fernandez wrote:
> > ambari-web/app/models/stack_service_component.js, line 200
> > 
> >
> > Can this come from metainfo instead of being hardcoded on the UI?
> > 
> > Please add Jaimin Jetly for input.

As we all know, there are two ways installing relative components in same host;

(1)fisrt method is as above, configs relative components in 
stack_service_component.js.
(2)second method is in metainfo,but cannot be shown in web. The method is as 
follows:


  true
  RANGER/RANGER_ADMIN


so suggest we can select one.
thanks for your reply.


- alice


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/6/#review161773
---


On 一月 17, 2017, 2:12 a.m., alice alice wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/6/
> ---
> 
> (Updated 一月 17, 2017, 2:12 a.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Jaimin Jetly, Jayush Luniya, 
> Zhe (Joe) Wang, Richard Zang, Sumit Mohanty, Sid Wagle, and Yusaku Sako.
> 
> 
> Bugs: AMBARI-19557
> https://issues.apache.org/jira/browse/AMBARI-19557
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_Ranger_Install_Guide/content/ch03s01.html??
> The Ranger Admin and Ranger Usersync services must be installed on the same 
> cluster node.
> so we'd betted install ranger_admin and ranger_usersync in same cluster node 
> in instaling at managing master hostcomponent
> 
> 
> Diffs
> -
> 
>   ambari-web/app/models/stack_service_component.js 17c2aa1 
> 
> Diff: https://reviews.apache.org/r/6/diff/
> 
> 
> Testing
> ---
> 
> done it
> 
> 
> Thanks,
> 
> alice alice
> 
>



Re: Review Request 55573: Hive View 2.0: Export Query Result

2017-01-17 Thread Nitiraj Rathore

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55573/#review161837
---


Ship it!




Ship It!

- Nitiraj Rathore


On Jan. 16, 2017, 12:39 p.m., Pallav Kulshreshtha wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55573/
> ---
> 
> (Updated Jan. 16, 2017, 12:39 p.m.)
> 
> 
> Review request for Ambari, DIPAYAN BHOWMICK, Gaurav Nagar, Nitiraj Rathore, 
> and Rohit Choudhary.
> 
> 
> Bugs: AMBARI-19566
> https://issues.apache.org/jira/browse/AMBARI-19566
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Added save as HDFS and download As Csv feature.
> 
> 
> Diffs
> -
> 
>   contrib/views/hive20/src/main/resources/ui/app/adapters/job.js e2f342e 
>   contrib/views/hive20/src/main/resources/ui/app/components/export-result.js 
> PRE-CREATION 
>   
> contrib/views/hive20/src/main/resources/ui/app/components/query-result-table.js
>  429dfb3 
>   contrib/views/hive20/src/main/resources/ui/app/components/save-hdfs.js 
> 05b3b33 
>   contrib/views/hive20/src/main/resources/ui/app/routes/queries/query.js 
> d4c82fa 
>   contrib/views/hive20/src/main/resources/ui/app/services/query.js d95a2e5 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/export-result.hbs
>  PRE-CREATION 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/query-result-table.hbs
>  4bda978 
>   
> contrib/views/hive20/src/main/resources/ui/app/templates/components/save-hdfs.hbs
>  5b53102 
>   contrib/views/hive20/src/main/resources/ui/app/templates/queries/query.hbs 
> 120a045 
> 
> Diff: https://reviews.apache.org/r/55573/diff/
> 
> 
> Testing
> ---
> 
> manually tested.
> 
> 
> Thanks,
> 
> Pallav Kulshreshtha
> 
>



Re: Review Request 55567: AMBARI-19563:Dashboard-Show YARN RM URL in actions and flow graph and organize tabs

2017-01-17 Thread Gaurav Nagar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55567/#review161834
---


Ship it!




Ship It!

- Gaurav Nagar


On Jan. 16, 2017, 10:32 a.m., Padma Priya N wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55567/
> ---
> 
> (Updated Jan. 16, 2017, 10:32 a.m.)
> 
> 
> Review request for Ambari, DIPAYAN BHOWMICK, Gaurav Nagar, Nitiraj Rathore, 
> and Pallav Kulshreshtha.
> 
> 
> Bugs: AMBARI-19563
> https://issues.apache.org/jira/browse/AMBARI-19563
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Console Url is available which takes to RM UI. But not very intuitive. 
> -We can add link in action column in actions row.
> -Also flow graph can be moved after actions column 
> -Also in flow graph, show RM url
> 
> 
> Diffs
> -
> 
>   contrib/views/wfmanager/src/main/resources/ui/app/components/job-details.js 
> 32f5ef4 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/components/workflow-job-details.js
>  4873a31 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/job-details.hbs
>  32e468f 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/workflow-job-action-info.hbs
>  8d1e09c 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/workflow-job-details.hbs
>  114ca37 
> 
> Diff: https://reviews.apache.org/r/55567/diff/
> 
> 
> Testing
> ---
> 
> Manual Testing
> 
> 
> Thanks,
> 
> Padma Priya N
> 
>



Re: Review Request 55566: AMBARI-19562: Save is not present for coordinator and bundle.

2017-01-17 Thread Gaurav Nagar

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55566/#review161833
---


Ship it!




Ship It!

- Gaurav Nagar


On Jan. 16, 2017, 9:44 a.m., Padma Priya N wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55566/
> ---
> 
> (Updated Jan. 16, 2017, 9:44 a.m.)
> 
> 
> Review request for Ambari, DIPAYAN BHOWMICK, Gaurav Nagar, Nitiraj Rathore, 
> and Pallav Kulshreshtha.
> 
> 
> Bugs: AMBARI-19562
> https://issues.apache.org/jira/browse/AMBARI-19562
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Save should be available for coordinator and bundle.
> 
> 
> Diffs
> -
> 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/components/bundle-config.js 
> c6a24b8 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/components/coord-config.js 
> 743a163 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/components/flow-designer.js 
> 9007838 
>   contrib/views/wfmanager/src/main/resources/ui/app/components/save-wf.js 
> d91c52a 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/domain/actionjob_hanlder.js 
> 0bb2fb8 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/bundle-config.hbs
>  249877b 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/coord-config.hbs
>  7ee7ecd 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/flow-designer.hbs
>  01356b2 
>   
> contrib/views/wfmanager/src/main/resources/ui/app/templates/components/save-wf.hbs
>  65bac42 
> 
> Diff: https://reviews.apache.org/r/55566/diff/
> 
> 
> Testing
> ---
> 
> Manual Testing
> 
> 
> Thanks,
> 
> Padma Priya N
> 
>



  1   2   >