[jira] [Resolved] (RANGER-2994) ranger release 2.1.0 cannot compile due to broken Kylin plugin dependency

2022-01-08 Thread Selvamohan Neethiraj (Jira)


 [ 
https://issues.apache.org/jira/browse/RANGER-2994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Selvamohan Neethiraj resolved RANGER-2994.
--
Resolution: Duplicate

Duplicate of RANGER-3560 ...

> ranger release 2.1.0 cannot compile due to broken Kylin plugin dependency
> -
>
> Key: RANGER-2994
> URL: https://issues.apache.org/jira/browse/RANGER-2994
> Project: Ranger
>  Issue Type: Bug
>  Components: plugins
>Affects Versions: 2.1.0
>Reporter: Georgi Ivanov
>Assignee: Selvamohan Neethiraj
>Priority: Major
> Fix For: 3.0.0, 2.1.1, 2.2.0
>
> Attachments: 
> 0001-RANGER-2994-kylin-library-version-is-updated-to-a-li.patch
>
>
> Ranger 2.1.0 release cannot compile due to broken kylin maven dependency.
> the kylin version is set to 2.6.4 in the main project pom.xml
>  
> 2.6.4
>  
> plugin-kylin/pom.xml
> ranger-kylin-plugin-shim/pom.xml
> both reference kylin-server-base which has dependency on kylin-datasource-sdk 
> which in turn has dependency on calcite-linq4j-1.16.0-kylin-r2.jar which is 
> not available.
>  
> mvn org.apache.maven.plugins:maven-dependency-plugin:3.1.2:copy 
> -Dartifact=org.apache.calcite:calcite-linq4j:jar:1.16.0-kylin-r2 
> -DoutputDirectory=./
> fails
> and 
> [https://mvnrepository.com/artifact/org.apache.kylin/kylin-datasource-sdk/2.6.4]
>  
> shows the broken dependency.
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Commented] (RANGER-3560) Upgrade kylin version to 2.6.6

2022-01-08 Thread Selvamohan Neethiraj (Jira)


[ 
https://issues.apache.org/jira/browse/RANGER-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471255#comment-17471255
 ] 

Selvamohan Neethiraj commented on RANGER-3560:
--

Patch Approved and Committed - 
https://gitbox.apache.org/repos/asf?p=ranger.git;a=commit;h=c644abfd54cdb92019f54dd468d0240100da5451

After commit, the master branch codebase has been able to build in 
https://ci-builds.apache.org/  after 6+ months of build failure.
https://ci-builds.apache.org/job/Ranger/job/ranger-master-mvn-build/431/



> Upgrade kylin version to 2.6.6
> --
>
> Key: RANGER-3560
> URL: https://issues.apache.org/jira/browse/RANGER-3560
> Project: Ranger
>  Issue Type: Wish
>  Components: Ranger
>Affects Versions: 3.0.0
>Reporter: Pradeep Agrawal
>Assignee: Pradeep Agrawal
>Priority: Major
> Fix For: 3.0.0
>
> Attachments: 0001-RANGER-3560-Upgrade-kylin-version-to-2.6.6.patch
>
>




--
This message was sent by Atlassian Jira
(v8.20.1#820001)


Re: Review Request 73775: RANGER-3560: Upgrade kylin version to 2.6.6

2022-01-08 Thread Selvamohan Neethiraj

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73775/#review223943
---


Ship it!




Ship It!

- Selvamohan Neethiraj


On Dec. 22, 2021, 10:50 a.m., Pradeep Agrawal wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73775/
> ---
> 
> (Updated Dec. 22, 2021, 10:50 a.m.)
> 
> 
> Review request for ranger, Dineshkumar Yadav, Kishor Gollapalliwar, Abhay 
> Kulkarni, Madhan Neethiraj, Mehul Parikh, Ramesh Mani, Selvamohan Neethiraj, 
> Sailaja Polavarapu, and Velmurugan Periasamy.
> 
> 
> Bugs: RANGER-3560
> https://issues.apache.org/jira/browse/RANGER-3560
> 
> 
> Repository: ranger
> 
> 
> Description
> ---
> 
> kylin version can be upgraded from 2.6.4 to 2.6.6
> 
> **Note:** If calcite libraries are removed from ~/.m2/repository/ then ranger 
> build fails, as dependent library calcite-linq4j version 1.16.0-kylin-r2 is 
> no more available. hence available library version 1.16.0 can be used. 
> calcite-linq4j is required during compile time only and will not be shipped.
> 
> Please refer RANGER-2994 and RANGER-2999 for more details about the build 
> failure.
> 
> 
> Diffs
> -
> 
>   plugin-kylin/pom.xml 9e6b0c970 
>   pom.xml f9c46f669 
>   ranger-kylin-plugin-shim/pom.xml 65410fd5d 
> 
> 
> Diff: https://reviews.apache.org/r/73775/diff/1/
> 
> 
> Testing
> ---
> 
> I am able to build ranger successfully with this patch.
> 
> 
> Thanks,
> 
> Pradeep Agrawal
> 
>



Re: Review Request 73795: RANGER-3498: replaced use of org.apache.log4j and org.apache.commons.logging with org.slf4j

2022-01-08 Thread Madhan Neethiraj

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73795/
---

(Updated Jan. 8, 2022, 10:45 p.m.)


Review request for ranger, Ankita Sinha, Kishor Gollapalliwar, Abhay Kulkarni, 
Mehul Parikh, Ramesh Mani, Selvamohan Neethiraj, Sailaja Polavarapu, and 
Velmurugan Periasamy.


Changes
---

- logback.xml for tests have been added/updated
- addressed unit test failures (it was due to incorrect logback.xml)


Bugs: RANGER-3498
https://issues.apache.org/jira/browse/RANGER-3498


Repository: ranger


Description
---

- consolidated usage of different log APIs (org.apache.log4j, 
org.apache.commons.loggig, org.slf4j) into a single API - org.slf4j
- removed all references to log4j-1.x
- replaced transitive log4j-1.x dependencies with log4j-over-slf4j
- using slf4j enables choosing between different implementations (like log4j2, 
logback, java utlity logging) via configuration without requiring code changes


Diffs (updated)
-

  agents-audit/pom.xml 151924915 
  
agents-audit/src/main/java/org/apache/ranger/audit/destination/AmazonCloudWatchAuditDestination.java
 b3c7af4d8 
  
agents-audit/src/main/java/org/apache/ranger/audit/destination/AuditDestination.java
 41d0e8278 
  
agents-audit/src/main/java/org/apache/ranger/audit/destination/ElasticSearchAuditDestination.java
 d4897a406 
  
agents-audit/src/main/java/org/apache/ranger/audit/destination/FileAuditDestination.java
 609b98520 
  
agents-audit/src/main/java/org/apache/ranger/audit/destination/HDFSAuditDestination.java
 474c3bae3 
  
agents-audit/src/main/java/org/apache/ranger/audit/destination/Log4JAuditDestination.java
 1dd35c92a 
  
agents-audit/src/main/java/org/apache/ranger/audit/destination/SolrAuditDestination.java
 8532bf8e9 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/AsyncAuditProvider.java
 c74a3eac0 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/AuditFileCacheProvider.java
 8e3dd720d 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/AuditProviderFactory.java
 78468790f 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/AuditWriterFactory.java
 6ef2255ec 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/BaseAuditHandler.java
 9a61fa938 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/Log4jAuditProvider.java
 353c80963 
  agents-audit/src/main/java/org/apache/ranger/audit/provider/Log4jTracer.java 
bdb1a4774 
  agents-audit/src/main/java/org/apache/ranger/audit/provider/MiscUtil.java 
268cb5701 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/MultiDestAuditProvider.java
 b829ac571 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/StandAloneAuditProviderFactory.java
 4306b24c0 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/hdfs/HdfsAuditProvider.java
 65429ad67 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/kafka/KafkaAuditProvider.java
 a0c25427a 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/solr/SolrAuditProvider.java
 1ef115a87 
  agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditAsyncQueue.java 
f31772ae5 
  agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditBatchQueue.java 
113a23016 
  
agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditFileCacheProviderSpool.java
 f6951c6d4 
  agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditFileQueue.java 
0b245c008 
  
agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditFileQueueSpool.java
 32847839c 
  agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditFileSpool.java 
f8c2aa5f3 
  agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditQueue.java 
e1667a47c 
  
agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditSummaryQueue.java 
4c250336c 
  agents-audit/src/main/java/org/apache/ranger/audit/test/TestEvents.java 
231cb8632 
  
agents-audit/src/main/java/org/apache/ranger/audit/utils/AbstractRangerAuditWriter.java
 d14bd389e 
  agents-audit/src/main/java/org/apache/ranger/audit/utils/KerberosAction.java 
18861b1df 
  agents-audit/src/main/java/org/apache/ranger/audit/utils/ORCFileUtil.java 
2e4378d6d 
  
agents-audit/src/main/java/org/apache/ranger/audit/utils/RangerJSONAuditWriter.java
 bc7bb4684 
  
agents-audit/src/main/java/org/apache/ranger/audit/utils/RangerORCAuditWriter.java
 a3cd140a9 
  agents-common/conf/log4j.properties dd22c6d42 
  agents-common/conf/logback.xml PRE-CREATION 
  agents-common/pom.xml ba9a18ca5 
  agents-common/src/main/java/org/apache/hadoop/security/SecureClientLogin.java 
e4d6a399f 
  
agents-common/src/main/java/org/apache/ranger/admin/client/RangerAdminRESTClient.java
 cf7e9cf66 
  
agents-common/src/main/java/org/apache/ranger/admin/client/datatype/RESTResponse.java
 75c2c9f38 
  

[jira] [Comment Edited] (RANGER-3498) RANGER : Remove log4j1 dependencies.

2022-01-08 Thread Madhan Neethiraj (Jira)


[ 
https://issues.apache.org/jira/browse/RANGER-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470487#comment-17470487
 ] 

Madhan Neethiraj edited comment on RANGER-3498 at 1/8/22, 11:49 AM:


Patch in [review board|https://reviews.apache.org/r/73795/].


was (Author: madhan.neethiraj):
Patch in [review board|https://reviews.apache.org/r/73788/].

> RANGER : Remove log4j1 dependencies.
> 
>
> Key: RANGER-3498
> URL: https://issues.apache.org/jira/browse/RANGER-3498
> Project: Ranger
>  Issue Type: Task
>  Components: Ranger
>Reporter: Mateen N Mansoori
>Assignee: Madhan Neethiraj
>Priority: Major
> Fix For: 3.0.0
>
>
> Remove log4j1 dependencies.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Comment Edited] (RANGER-3498) RANGER : Remove log4j1 dependencies.

2022-01-08 Thread Madhan Neethiraj (Jira)


[ 
https://issues.apache.org/jira/browse/RANGER-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470487#comment-17470487
 ] 

Madhan Neethiraj edited comment on RANGER-3498 at 1/8/22, 11:49 AM:


Patch in [review board|https://reviews.apache.org/r/73795/].


was (Author: madhan.neethiraj):
Patch in [review board|https://reviews.apache.org/r/73795/].

> RANGER : Remove log4j1 dependencies.
> 
>
> Key: RANGER-3498
> URL: https://issues.apache.org/jira/browse/RANGER-3498
> Project: Ranger
>  Issue Type: Task
>  Components: Ranger
>Reporter: Mateen N Mansoori
>Assignee: Madhan Neethiraj
>Priority: Major
> Fix For: 3.0.0
>
>
> Remove log4j1 dependencies.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


Review Request 73795: RANGER-3498: replaced use of org.apache.log4j and org.apache.commons.logging with org.slf4j

2022-01-08 Thread Madhan Neethiraj

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73795/
---

Review request for ranger, Ankita Sinha, Kishor Gollapalliwar, Abhay Kulkarni, 
Mehul Parikh, Ramesh Mani, Selvamohan Neethiraj, Sailaja Polavarapu, and 
Velmurugan Periasamy.


Bugs: RANGER-3498
https://issues.apache.org/jira/browse/RANGER-3498


Repository: ranger


Description
---

- consolidated usage of different log APIs (org.apache.log4j, 
org.apache.commons.loggig, org.slf4j) into a single API - org.slf4j
- removed all references to log4j-1.x
- replaced transitive log4j-1.x dependencies with log4j-over-slf4j
- using slf4j enables choosing between different implementations (like log4j2, 
logback, java utlity logging) via configuration without requiring code changes


Diffs
-

  agents-audit/pom.xml 151924915 
  
agents-audit/src/main/java/org/apache/ranger/audit/destination/AmazonCloudWatchAuditDestination.java
 b3c7af4d8 
  
agents-audit/src/main/java/org/apache/ranger/audit/destination/AuditDestination.java
 41d0e8278 
  
agents-audit/src/main/java/org/apache/ranger/audit/destination/ElasticSearchAuditDestination.java
 d4897a406 
  
agents-audit/src/main/java/org/apache/ranger/audit/destination/FileAuditDestination.java
 609b98520 
  
agents-audit/src/main/java/org/apache/ranger/audit/destination/HDFSAuditDestination.java
 474c3bae3 
  
agents-audit/src/main/java/org/apache/ranger/audit/destination/Log4JAuditDestination.java
 1dd35c92a 
  
agents-audit/src/main/java/org/apache/ranger/audit/destination/SolrAuditDestination.java
 8532bf8e9 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/AsyncAuditProvider.java
 c74a3eac0 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/AuditFileCacheProvider.java
 8e3dd720d 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/AuditProviderFactory.java
 78468790f 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/AuditWriterFactory.java
 6ef2255ec 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/BaseAuditHandler.java
 9a61fa938 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/Log4jAuditProvider.java
 353c80963 
  agents-audit/src/main/java/org/apache/ranger/audit/provider/Log4jTracer.java 
bdb1a4774 
  agents-audit/src/main/java/org/apache/ranger/audit/provider/MiscUtil.java 
268cb5701 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/MultiDestAuditProvider.java
 b829ac571 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/StandAloneAuditProviderFactory.java
 4306b24c0 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/hdfs/HdfsAuditProvider.java
 65429ad67 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/kafka/KafkaAuditProvider.java
 a0c25427a 
  
agents-audit/src/main/java/org/apache/ranger/audit/provider/solr/SolrAuditProvider.java
 1ef115a87 
  agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditAsyncQueue.java 
f31772ae5 
  agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditBatchQueue.java 
113a23016 
  
agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditFileCacheProviderSpool.java
 f6951c6d4 
  agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditFileQueue.java 
0b245c008 
  
agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditFileQueueSpool.java
 32847839c 
  agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditFileSpool.java 
f8c2aa5f3 
  agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditQueue.java 
e1667a47c 
  
agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditSummaryQueue.java 
4c250336c 
  agents-audit/src/main/java/org/apache/ranger/audit/test/TestEvents.java 
231cb8632 
  
agents-audit/src/main/java/org/apache/ranger/audit/utils/AbstractRangerAuditWriter.java
 d14bd389e 
  agents-audit/src/main/java/org/apache/ranger/audit/utils/KerberosAction.java 
18861b1df 
  agents-audit/src/main/java/org/apache/ranger/audit/utils/ORCFileUtil.java 
2e4378d6d 
  
agents-audit/src/main/java/org/apache/ranger/audit/utils/RangerJSONAuditWriter.java
 bc7bb4684 
  
agents-audit/src/main/java/org/apache/ranger/audit/utils/RangerORCAuditWriter.java
 a3cd140a9 
  agents-common/conf/log4j.properties dd22c6d42 
  agents-common/conf/logback.xml PRE-CREATION 
  agents-common/pom.xml ba9a18ca5 
  agents-common/src/main/java/org/apache/hadoop/security/SecureClientLogin.java 
e4d6a399f 
  
agents-common/src/main/java/org/apache/ranger/admin/client/RangerAdminRESTClient.java
 cf7e9cf66 
  
agents-common/src/main/java/org/apache/ranger/admin/client/datatype/RESTResponse.java
 75c2c9f38 
  
agents-common/src/main/java/org/apache/ranger/authorization/hadoop/config/RangerAdminConfig.java
 af47a2036 
  
agents-common/src/main/java/org/apache/ranger/authorization/hadoop/config/RangerAuditConfig.java
 d6ba00ab5