[jira] [Resolved] (RANGER-2994) ranger release 2.1.0 cannot compile due to broken Kylin plugin dependency
[ https://issues.apache.org/jira/browse/RANGER-2994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Selvamohan Neethiraj resolved RANGER-2994. -- Resolution: Duplicate Duplicate of RANGER-3560 ... > ranger release 2.1.0 cannot compile due to broken Kylin plugin dependency > - > > Key: RANGER-2994 > URL: https://issues.apache.org/jira/browse/RANGER-2994 > Project: Ranger > Issue Type: Bug > Components: plugins >Affects Versions: 2.1.0 >Reporter: Georgi Ivanov >Assignee: Selvamohan Neethiraj >Priority: Major > Fix For: 3.0.0, 2.1.1, 2.2.0 > > Attachments: > 0001-RANGER-2994-kylin-library-version-is-updated-to-a-li.patch > > > Ranger 2.1.0 release cannot compile due to broken kylin maven dependency. > the kylin version is set to 2.6.4 in the main project pom.xml > > 2.6.4 > > plugin-kylin/pom.xml > ranger-kylin-plugin-shim/pom.xml > both reference kylin-server-base which has dependency on kylin-datasource-sdk > which in turn has dependency on calcite-linq4j-1.16.0-kylin-r2.jar which is > not available. > > mvn org.apache.maven.plugins:maven-dependency-plugin:3.1.2:copy > -Dartifact=org.apache.calcite:calcite-linq4j:jar:1.16.0-kylin-r2 > -DoutputDirectory=./ > fails > and > [https://mvnrepository.com/artifact/org.apache.kylin/kylin-datasource-sdk/2.6.4] > > shows the broken dependency. > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (RANGER-3560) Upgrade kylin version to 2.6.6
[ https://issues.apache.org/jira/browse/RANGER-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471255#comment-17471255 ] Selvamohan Neethiraj commented on RANGER-3560: -- Patch Approved and Committed - https://gitbox.apache.org/repos/asf?p=ranger.git;a=commit;h=c644abfd54cdb92019f54dd468d0240100da5451 After commit, the master branch codebase has been able to build in https://ci-builds.apache.org/ after 6+ months of build failure. https://ci-builds.apache.org/job/Ranger/job/ranger-master-mvn-build/431/ > Upgrade kylin version to 2.6.6 > -- > > Key: RANGER-3560 > URL: https://issues.apache.org/jira/browse/RANGER-3560 > Project: Ranger > Issue Type: Wish > Components: Ranger >Affects Versions: 3.0.0 >Reporter: Pradeep Agrawal >Assignee: Pradeep Agrawal >Priority: Major > Fix For: 3.0.0 > > Attachments: 0001-RANGER-3560-Upgrade-kylin-version-to-2.6.6.patch > > -- This message was sent by Atlassian Jira (v8.20.1#820001)
Re: Review Request 73775: RANGER-3560: Upgrade kylin version to 2.6.6
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/73775/#review223943 --- Ship it! Ship It! - Selvamohan Neethiraj On Dec. 22, 2021, 10:50 a.m., Pradeep Agrawal wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/73775/ > --- > > (Updated Dec. 22, 2021, 10:50 a.m.) > > > Review request for ranger, Dineshkumar Yadav, Kishor Gollapalliwar, Abhay > Kulkarni, Madhan Neethiraj, Mehul Parikh, Ramesh Mani, Selvamohan Neethiraj, > Sailaja Polavarapu, and Velmurugan Periasamy. > > > Bugs: RANGER-3560 > https://issues.apache.org/jira/browse/RANGER-3560 > > > Repository: ranger > > > Description > --- > > kylin version can be upgraded from 2.6.4 to 2.6.6 > > **Note:** If calcite libraries are removed from ~/.m2/repository/ then ranger > build fails, as dependent library calcite-linq4j version 1.16.0-kylin-r2 is > no more available. hence available library version 1.16.0 can be used. > calcite-linq4j is required during compile time only and will not be shipped. > > Please refer RANGER-2994 and RANGER-2999 for more details about the build > failure. > > > Diffs > - > > plugin-kylin/pom.xml 9e6b0c970 > pom.xml f9c46f669 > ranger-kylin-plugin-shim/pom.xml 65410fd5d > > > Diff: https://reviews.apache.org/r/73775/diff/1/ > > > Testing > --- > > I am able to build ranger successfully with this patch. > > > Thanks, > > Pradeep Agrawal > >
Re: Review Request 73795: RANGER-3498: replaced use of org.apache.log4j and org.apache.commons.logging with org.slf4j
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/73795/ --- (Updated Jan. 8, 2022, 10:45 p.m.) Review request for ranger, Ankita Sinha, Kishor Gollapalliwar, Abhay Kulkarni, Mehul Parikh, Ramesh Mani, Selvamohan Neethiraj, Sailaja Polavarapu, and Velmurugan Periasamy. Changes --- - logback.xml for tests have been added/updated - addressed unit test failures (it was due to incorrect logback.xml) Bugs: RANGER-3498 https://issues.apache.org/jira/browse/RANGER-3498 Repository: ranger Description --- - consolidated usage of different log APIs (org.apache.log4j, org.apache.commons.loggig, org.slf4j) into a single API - org.slf4j - removed all references to log4j-1.x - replaced transitive log4j-1.x dependencies with log4j-over-slf4j - using slf4j enables choosing between different implementations (like log4j2, logback, java utlity logging) via configuration without requiring code changes Diffs (updated) - agents-audit/pom.xml 151924915 agents-audit/src/main/java/org/apache/ranger/audit/destination/AmazonCloudWatchAuditDestination.java b3c7af4d8 agents-audit/src/main/java/org/apache/ranger/audit/destination/AuditDestination.java 41d0e8278 agents-audit/src/main/java/org/apache/ranger/audit/destination/ElasticSearchAuditDestination.java d4897a406 agents-audit/src/main/java/org/apache/ranger/audit/destination/FileAuditDestination.java 609b98520 agents-audit/src/main/java/org/apache/ranger/audit/destination/HDFSAuditDestination.java 474c3bae3 agents-audit/src/main/java/org/apache/ranger/audit/destination/Log4JAuditDestination.java 1dd35c92a agents-audit/src/main/java/org/apache/ranger/audit/destination/SolrAuditDestination.java 8532bf8e9 agents-audit/src/main/java/org/apache/ranger/audit/provider/AsyncAuditProvider.java c74a3eac0 agents-audit/src/main/java/org/apache/ranger/audit/provider/AuditFileCacheProvider.java 8e3dd720d agents-audit/src/main/java/org/apache/ranger/audit/provider/AuditProviderFactory.java 78468790f agents-audit/src/main/java/org/apache/ranger/audit/provider/AuditWriterFactory.java 6ef2255ec agents-audit/src/main/java/org/apache/ranger/audit/provider/BaseAuditHandler.java 9a61fa938 agents-audit/src/main/java/org/apache/ranger/audit/provider/Log4jAuditProvider.java 353c80963 agents-audit/src/main/java/org/apache/ranger/audit/provider/Log4jTracer.java bdb1a4774 agents-audit/src/main/java/org/apache/ranger/audit/provider/MiscUtil.java 268cb5701 agents-audit/src/main/java/org/apache/ranger/audit/provider/MultiDestAuditProvider.java b829ac571 agents-audit/src/main/java/org/apache/ranger/audit/provider/StandAloneAuditProviderFactory.java 4306b24c0 agents-audit/src/main/java/org/apache/ranger/audit/provider/hdfs/HdfsAuditProvider.java 65429ad67 agents-audit/src/main/java/org/apache/ranger/audit/provider/kafka/KafkaAuditProvider.java a0c25427a agents-audit/src/main/java/org/apache/ranger/audit/provider/solr/SolrAuditProvider.java 1ef115a87 agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditAsyncQueue.java f31772ae5 agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditBatchQueue.java 113a23016 agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditFileCacheProviderSpool.java f6951c6d4 agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditFileQueue.java 0b245c008 agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditFileQueueSpool.java 32847839c agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditFileSpool.java f8c2aa5f3 agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditQueue.java e1667a47c agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditSummaryQueue.java 4c250336c agents-audit/src/main/java/org/apache/ranger/audit/test/TestEvents.java 231cb8632 agents-audit/src/main/java/org/apache/ranger/audit/utils/AbstractRangerAuditWriter.java d14bd389e agents-audit/src/main/java/org/apache/ranger/audit/utils/KerberosAction.java 18861b1df agents-audit/src/main/java/org/apache/ranger/audit/utils/ORCFileUtil.java 2e4378d6d agents-audit/src/main/java/org/apache/ranger/audit/utils/RangerJSONAuditWriter.java bc7bb4684 agents-audit/src/main/java/org/apache/ranger/audit/utils/RangerORCAuditWriter.java a3cd140a9 agents-common/conf/log4j.properties dd22c6d42 agents-common/conf/logback.xml PRE-CREATION agents-common/pom.xml ba9a18ca5 agents-common/src/main/java/org/apache/hadoop/security/SecureClientLogin.java e4d6a399f agents-common/src/main/java/org/apache/ranger/admin/client/RangerAdminRESTClient.java cf7e9cf66 agents-common/src/main/java/org/apache/ranger/admin/client/datatype/RESTResponse.java 75c2c9f38
[jira] [Comment Edited] (RANGER-3498) RANGER : Remove log4j1 dependencies.
[ https://issues.apache.org/jira/browse/RANGER-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470487#comment-17470487 ] Madhan Neethiraj edited comment on RANGER-3498 at 1/8/22, 11:49 AM: Patch in [review board|https://reviews.apache.org/r/73795/]. was (Author: madhan.neethiraj): Patch in [review board|https://reviews.apache.org/r/73788/]. > RANGER : Remove log4j1 dependencies. > > > Key: RANGER-3498 > URL: https://issues.apache.org/jira/browse/RANGER-3498 > Project: Ranger > Issue Type: Task > Components: Ranger >Reporter: Mateen N Mansoori >Assignee: Madhan Neethiraj >Priority: Major > Fix For: 3.0.0 > > > Remove log4j1 dependencies. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Comment Edited] (RANGER-3498) RANGER : Remove log4j1 dependencies.
[ https://issues.apache.org/jira/browse/RANGER-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470487#comment-17470487 ] Madhan Neethiraj edited comment on RANGER-3498 at 1/8/22, 11:49 AM: Patch in [review board|https://reviews.apache.org/r/73795/]. was (Author: madhan.neethiraj): Patch in [review board|https://reviews.apache.org/r/73795/]. > RANGER : Remove log4j1 dependencies. > > > Key: RANGER-3498 > URL: https://issues.apache.org/jira/browse/RANGER-3498 > Project: Ranger > Issue Type: Task > Components: Ranger >Reporter: Mateen N Mansoori >Assignee: Madhan Neethiraj >Priority: Major > Fix For: 3.0.0 > > > Remove log4j1 dependencies. -- This message was sent by Atlassian Jira (v8.20.1#820001)
Review Request 73795: RANGER-3498: replaced use of org.apache.log4j and org.apache.commons.logging with org.slf4j
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/73795/ --- Review request for ranger, Ankita Sinha, Kishor Gollapalliwar, Abhay Kulkarni, Mehul Parikh, Ramesh Mani, Selvamohan Neethiraj, Sailaja Polavarapu, and Velmurugan Periasamy. Bugs: RANGER-3498 https://issues.apache.org/jira/browse/RANGER-3498 Repository: ranger Description --- - consolidated usage of different log APIs (org.apache.log4j, org.apache.commons.loggig, org.slf4j) into a single API - org.slf4j - removed all references to log4j-1.x - replaced transitive log4j-1.x dependencies with log4j-over-slf4j - using slf4j enables choosing between different implementations (like log4j2, logback, java utlity logging) via configuration without requiring code changes Diffs - agents-audit/pom.xml 151924915 agents-audit/src/main/java/org/apache/ranger/audit/destination/AmazonCloudWatchAuditDestination.java b3c7af4d8 agents-audit/src/main/java/org/apache/ranger/audit/destination/AuditDestination.java 41d0e8278 agents-audit/src/main/java/org/apache/ranger/audit/destination/ElasticSearchAuditDestination.java d4897a406 agents-audit/src/main/java/org/apache/ranger/audit/destination/FileAuditDestination.java 609b98520 agents-audit/src/main/java/org/apache/ranger/audit/destination/HDFSAuditDestination.java 474c3bae3 agents-audit/src/main/java/org/apache/ranger/audit/destination/Log4JAuditDestination.java 1dd35c92a agents-audit/src/main/java/org/apache/ranger/audit/destination/SolrAuditDestination.java 8532bf8e9 agents-audit/src/main/java/org/apache/ranger/audit/provider/AsyncAuditProvider.java c74a3eac0 agents-audit/src/main/java/org/apache/ranger/audit/provider/AuditFileCacheProvider.java 8e3dd720d agents-audit/src/main/java/org/apache/ranger/audit/provider/AuditProviderFactory.java 78468790f agents-audit/src/main/java/org/apache/ranger/audit/provider/AuditWriterFactory.java 6ef2255ec agents-audit/src/main/java/org/apache/ranger/audit/provider/BaseAuditHandler.java 9a61fa938 agents-audit/src/main/java/org/apache/ranger/audit/provider/Log4jAuditProvider.java 353c80963 agents-audit/src/main/java/org/apache/ranger/audit/provider/Log4jTracer.java bdb1a4774 agents-audit/src/main/java/org/apache/ranger/audit/provider/MiscUtil.java 268cb5701 agents-audit/src/main/java/org/apache/ranger/audit/provider/MultiDestAuditProvider.java b829ac571 agents-audit/src/main/java/org/apache/ranger/audit/provider/StandAloneAuditProviderFactory.java 4306b24c0 agents-audit/src/main/java/org/apache/ranger/audit/provider/hdfs/HdfsAuditProvider.java 65429ad67 agents-audit/src/main/java/org/apache/ranger/audit/provider/kafka/KafkaAuditProvider.java a0c25427a agents-audit/src/main/java/org/apache/ranger/audit/provider/solr/SolrAuditProvider.java 1ef115a87 agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditAsyncQueue.java f31772ae5 agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditBatchQueue.java 113a23016 agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditFileCacheProviderSpool.java f6951c6d4 agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditFileQueue.java 0b245c008 agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditFileQueueSpool.java 32847839c agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditFileSpool.java f8c2aa5f3 agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditQueue.java e1667a47c agents-audit/src/main/java/org/apache/ranger/audit/queue/AuditSummaryQueue.java 4c250336c agents-audit/src/main/java/org/apache/ranger/audit/test/TestEvents.java 231cb8632 agents-audit/src/main/java/org/apache/ranger/audit/utils/AbstractRangerAuditWriter.java d14bd389e agents-audit/src/main/java/org/apache/ranger/audit/utils/KerberosAction.java 18861b1df agents-audit/src/main/java/org/apache/ranger/audit/utils/ORCFileUtil.java 2e4378d6d agents-audit/src/main/java/org/apache/ranger/audit/utils/RangerJSONAuditWriter.java bc7bb4684 agents-audit/src/main/java/org/apache/ranger/audit/utils/RangerORCAuditWriter.java a3cd140a9 agents-common/conf/log4j.properties dd22c6d42 agents-common/conf/logback.xml PRE-CREATION agents-common/pom.xml ba9a18ca5 agents-common/src/main/java/org/apache/hadoop/security/SecureClientLogin.java e4d6a399f agents-common/src/main/java/org/apache/ranger/admin/client/RangerAdminRESTClient.java cf7e9cf66 agents-common/src/main/java/org/apache/ranger/admin/client/datatype/RESTResponse.java 75c2c9f38 agents-common/src/main/java/org/apache/ranger/authorization/hadoop/config/RangerAdminConfig.java af47a2036 agents-common/src/main/java/org/apache/ranger/authorization/hadoop/config/RangerAuditConfig.java d6ba00ab5