[jira] [Commented] (RANGER-3245) Use OpenJDK in TravisCI config instead of OracleJDK
[ https://issues.apache.org/jira/browse/RANGER-3245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17437003#comment-17437003 ] Martin Tzvetanov Grigorov commented on RANGER-3245: --- Done! > Use OpenJDK in TravisCI config instead of OracleJDK > --- > > Key: RANGER-3245 > URL: https://issues.apache.org/jira/browse/RANGER-3245 > Project: Ranger > Issue Type: Task > Components: build-infra >Affects Versions: 3.0.0, 2.2.0 >Reporter: Martin Tzvetanov Grigorov >Priority: Minor > Fix For: 3.0.0, 2.2.0 > > > OpenJDK is recommended at TravisCI these days. > OracleJDK 8 is no more available for any version of Ubuntu there. > Manually install OpenJDK from Ubuntu repositories (i.e. apt install > openjdk-11-jdk) because the pre-installed one from TravisCI is too old, e.g. > JDK 11.0.2 instead of 11.0.10. > Add a job to build and test on ARM64 - a more complete version of > https://github.com/apache/ranger/pull/91. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3243) Build fails on JDK 8 and 11
[ https://issues.apache.org/jira/browse/RANGER-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17437002#comment-17437002 ] Martin Tzvetanov Grigorov commented on RANGER-3243: --- Closed it! > Build fails on JDK 8 and 11 > --- > > Key: RANGER-3243 > URL: https://issues.apache.org/jira/browse/RANGER-3243 > Project: Ranger > Issue Type: Task > Components: build-infra >Affects Versions: 3.0.0, 2.2.0 >Reporter: Martin Tzvetanov Grigorov >Priority: Major > Fix For: 3.0.0, 2.2.0 > > Attachments: 0001-RANGER-3243-Build-fails-on-JDK-8-and-11.patch > > Time Spent: 40m > Remaining Estimate: 0h > > The build of current master branch fails - > [https://travis-ci.com/github/apache/ranger/builds/223139469] > There are several issues: > [Issue 1|https://reviews.apache.org/r/73281/bugs/1/]) > org.apache.ranger.authorization.presto.authorizer.RangerSystemAccessControlFactory > was not able to import com.google.common.base.Throwables.throwIfUnchecked > because it was coming from an old copy of Guava's Throwables shaded in > hive-exec. > By replacing hive-exec with orc-core in agents-audit module all depending > modules use their preferred version of Guava (26.0-jre) > [Issue 2|https://reviews.apache.org/r/73281/bugs/2/]) > RangerSafenetKeySecure.java uses directly sun.security.pkcs11.SunPKCS11 - a > class that is not available in Java 9+ and this breaks the compilation. > This should use reflection to load SunPKCS11 class dynamically. > [Issue 3|https://reviews.apache.org/r/73281/bugs/3/]) JAXB is no more part of > JDK 11+ > [Issue 4|https://reviews.apache.org/r/73281/bugs/4/]) JUnit 4 > Assert.assertThat() is deprecated in favour of Hamcrest's > MatcherAssert.assertThat(). This fixes a compilation issue with JDK11. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (RANGER-3450) Use headless Firefox for e2e tests instead of PhantomJS
[ https://issues.apache.org/jira/browse/RANGER-3450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Tzvetanov Grigorov resolved RANGER-3450. --- Resolution: Not A Problem My browser prefilled wrong Apache project in the issue creation form. This is not for Apache Ranger. There is RANGER-3300 for this already. > Use headless Firefox for e2e tests instead of PhantomJS > --- > > Key: RANGER-3450 > URL: https://issues.apache.org/jira/browse/RANGER-3450 > Project: Ranger > Issue Type: Improvement > Components: build-infra >Affects Versions: 2.1.0 >Reporter: Martin Tzvetanov Grigorov >Priority: Minor > > PhantomJS is not maintained since few years. It lacks behind modern web > standards and in addition it does not have a binary for Linux ARM64. > It would be better to use headless browser, e.g. Firefox. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (RANGER-3450) Use headless Firefox for e2e tests instead of PhantomJS
Martin Tzvetanov Grigorov created RANGER-3450: - Summary: Use headless Firefox for e2e tests instead of PhantomJS Key: RANGER-3450 URL: https://issues.apache.org/jira/browse/RANGER-3450 Project: Ranger Issue Type: Improvement Components: build-infra Affects Versions: 2.1.0 Reporter: Martin Tzvetanov Grigorov PhantomJS is not maintained since few years. It lacks behind modern web standards and in addition it does not have a binary for Linux ARM64. It would be better to use headless browser, e.g. Firefox. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3245) Use OpenJDK in TravisCI config instead of OracleJDK
[ https://issues.apache.org/jira/browse/RANGER-3245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420509#comment-17420509 ] Martin Tzvetanov Grigorov commented on RANGER-3245: --- The build at TravisCI is green for JDK 1.8 on Linux AMD64, and JDK 11 on Linux AMD64 and ARM64: [https://app.travis-ci.com/github/apache/ranger/builds/238525090!] I've updated [https://reviews.apache.org/r/73283/] ! > Use OpenJDK in TravisCI config instead of OracleJDK > --- > > Key: RANGER-3245 > URL: https://issues.apache.org/jira/browse/RANGER-3245 > Project: Ranger > Issue Type: Task > Components: build-infra >Affects Versions: 3.0.0, 2.2.0 >Reporter: Martin Tzvetanov Grigorov >Priority: Minor > Fix For: 3.0.0 > > > OpenJDK is recommended at TravisCI these days. > OracleJDK 8 is no more available for any version of Ubuntu there. > Manually install OpenJDK from Ubuntu repositories (i.e. apt install > openjdk-11-jdk) because the pre-installed one from TravisCI is too old, e.g. > JDK 11.0.2 instead of 11.0.10. > Add a job to build and test on ARM64 - a more complete version of > https://github.com/apache/ranger/pull/91. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (RANGER-3245) Use OpenJDK in TravisCI config instead of OracleJDK
[ https://issues.apache.org/jira/browse/RANGER-3245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420490#comment-17420490 ] Martin Tzvetanov Grigorov edited comment on RANGER-3245 at 9/27/21, 6:34 AM: - I see the change to Atlas 2.2.0 has been made: [https://github.com/apache/ranger/commit/dd283ef856f97d85162b3470ab85de9364d1af63] The new build for this issue is: https://app.travis-ci.com/github/apache/ranger/builds/238525090 was (Author: mgrigorov): I see the change to Atlas 2.2.0 has been made: [https://github.com/apache/ranger/commit/dd283ef856f97d85162b3470ab85de9364d1af63] The new build for this issue is: [https://app.travis-ci.com/github/apache/ranger/builds/238523279|https://app.travis-ci.com/github/apache/ranger/builds/238523196] > Use OpenJDK in TravisCI config instead of OracleJDK > --- > > Key: RANGER-3245 > URL: https://issues.apache.org/jira/browse/RANGER-3245 > Project: Ranger > Issue Type: Task > Components: build-infra >Affects Versions: 3.0.0, 2.2.0 >Reporter: Martin Tzvetanov Grigorov >Priority: Minor > Fix For: 3.0.0 > > > OpenJDK is recommended at TravisCI these days. > OracleJDK 8 is no more available for any version of Ubuntu there. > Manually install OpenJDK from Ubuntu repositories (i.e. apt install > openjdk-11-jdk) because the pre-installed one from TravisCI is too old, e.g. > JDK 11.0.2 instead of 11.0.10. > Add a job to build and test on ARM64 - a more complete version of > https://github.com/apache/ranger/pull/91. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (RANGER-3245) Use OpenJDK in TravisCI config instead of OracleJDK
[ https://issues.apache.org/jira/browse/RANGER-3245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420490#comment-17420490 ] Martin Tzvetanov Grigorov edited comment on RANGER-3245 at 9/27/21, 5:52 AM: - I see the change to Atlas 2.2.0 has been made: [https://github.com/apache/ranger/commit/dd283ef856f97d85162b3470ab85de9364d1af63] The new build for this issue is: [https://app.travis-ci.com/github/apache/ranger/builds/238523279|https://app.travis-ci.com/github/apache/ranger/builds/238523196] was (Author: mgrigorov): I see the change to Atlas 2.2.0 has been made: https://github.com/apache/ranger/commit/dd283ef856f97d85162b3470ab85de9364d1af63 The new build for this issue is: https://app.travis-ci.com/github/apache/ranger/builds/238523196 > Use OpenJDK in TravisCI config instead of OracleJDK > --- > > Key: RANGER-3245 > URL: https://issues.apache.org/jira/browse/RANGER-3245 > Project: Ranger > Issue Type: Task > Components: build-infra >Affects Versions: 3.0.0, 2.2.0 >Reporter: Martin Tzvetanov Grigorov >Priority: Minor > Fix For: 3.0.0 > > > OpenJDK is recommended at TravisCI these days. > OracleJDK 8 is no more available for any version of Ubuntu there. > Manually install OpenJDK from Ubuntu repositories (i.e. apt install > openjdk-11-jdk) because the pre-installed one from TravisCI is too old, e.g. > JDK 11.0.2 instead of 11.0.10. > Add a job to build and test on ARM64 - a more complete version of > https://github.com/apache/ranger/pull/91. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3245) Use OpenJDK in TravisCI config instead of OracleJDK
[ https://issues.apache.org/jira/browse/RANGER-3245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420490#comment-17420490 ] Martin Tzvetanov Grigorov commented on RANGER-3245: --- I see the change to Atlas 2.2.0 has been made: https://github.com/apache/ranger/commit/dd283ef856f97d85162b3470ab85de9364d1af63 The new build for this issue is: https://app.travis-ci.com/github/apache/ranger/builds/238523196 > Use OpenJDK in TravisCI config instead of OracleJDK > --- > > Key: RANGER-3245 > URL: https://issues.apache.org/jira/browse/RANGER-3245 > Project: Ranger > Issue Type: Task > Components: build-infra >Affects Versions: 3.0.0, 2.2.0 >Reporter: Martin Tzvetanov Grigorov >Priority: Minor > Fix For: 3.0.0 > > > OpenJDK is recommended at TravisCI these days. > OracleJDK 8 is no more available for any version of Ubuntu there. > Manually install OpenJDK from Ubuntu repositories (i.e. apt install > openjdk-11-jdk) because the pre-installed one from TravisCI is too old, e.g. > JDK 11.0.2 instead of 11.0.10. > Add a job to build and test on ARM64 - a more complete version of > https://github.com/apache/ranger/pull/91. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3245) Use OpenJDK in TravisCI config instead of OracleJDK
[ https://issues.apache.org/jira/browse/RANGER-3245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17419707#comment-17419707 ] Martin Tzvetanov Grigorov commented on RANGER-3245: --- The new build is here: https://app.travis-ci.com/github/apache/ranger/builds/238415435 > Use OpenJDK in TravisCI config instead of OracleJDK > --- > > Key: RANGER-3245 > URL: https://issues.apache.org/jira/browse/RANGER-3245 > Project: Ranger > Issue Type: Task > Components: build-infra >Reporter: Martin Tzvetanov Grigorov >Priority: Minor > > OpenJDK is recommended at TravisCI these days. > OracleJDK 8 is no more available for any version of Ubuntu there. > Manually install OpenJDK from Ubuntu repositories (i.e. apt install > openjdk-11-jdk) because the pre-installed one from TravisCI is too old, e.g. > JDK 11.0.2 instead of 11.0.10. > Add a job to build and test on ARM64 - a more complete version of > https://github.com/apache/ranger/pull/91. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3245) Use OpenJDK in TravisCI config instead of OracleJDK
[ https://issues.apache.org/jira/browse/RANGER-3245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17419702#comment-17419702 ] Martin Tzvetanov Grigorov commented on RANGER-3245: --- It seems the build has been executed after all! But the jobs failed while fetching -SNAPSHOTs of Apache Atlas artifacts. I will try again! > Use OpenJDK in TravisCI config instead of OracleJDK > --- > > Key: RANGER-3245 > URL: https://issues.apache.org/jira/browse/RANGER-3245 > Project: Ranger > Issue Type: Task > Components: build-infra >Reporter: Martin Tzvetanov Grigorov >Priority: Minor > > OpenJDK is recommended at TravisCI these days. > OracleJDK 8 is no more available for any version of Ubuntu there. > Manually install OpenJDK from Ubuntu repositories (i.e. apt install > openjdk-11-jdk) because the pre-installed one from TravisCI is too old, e.g. > JDK 11.0.2 instead of 11.0.10. > Add a job to build and test on ARM64 - a more complete version of > https://github.com/apache/ranger/pull/91. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3245) Use OpenJDK in TravisCI config instead of OracleJDK
[
https://issues.apache.org/jira/browse/RANGER-3245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17419595#comment-17419595
]
Martin Tzvetanov Grigorov commented on RANGER-3245:
---
It seems it won't be executed.
ASF is out of credits at TravisCI:
[https://the-asf.slack.com/archives/CBX4TSBQ8/p1632464616022300]
This is a chat between me and Gavin from Apache Infra:
{code:java}
mgrigorov 9:23 AM Hi! What is the status of Apache @ TravisCI today ? Out of
credits ?
Gavin McDonald 9:24 AM Yup
Gavin McDonald 9:24 AM We wont be getting any more
mgrigorov 9:24 AM ouch!
Gavin McDonald 9:24 AM Will have to diagnose who is using what and reign in
some projects usage
9:24 I’ll post to the builds@ list
9:25 Basically a couple of projects used up our 4 minutes we get a month,
within 3 days
mgrigorov 9:26 AM I guess most will move to GitHub Actions. Too bad they still
don't support Linux ARM64
9:27 Let's see how many of the projects I am interested in will agree to move
to CircleCI !
Gavin McDonald 9:27 AM We should also investigate if some project wants to
trial building in Azure and/or Artifactory (edited) {code}
> Use OpenJDK in TravisCI config instead of OracleJDK
> ---
>
> Key: RANGER-3245
> URL: https://issues.apache.org/jira/browse/RANGER-3245
> Project: Ranger
> Issue Type: Task
> Components: build-infra
>Reporter: Martin Tzvetanov Grigorov
>Priority: Minor
>
> OpenJDK is recommended at TravisCI these days.
> OracleJDK 8 is no more available for any version of Ubuntu there.
> Manually install OpenJDK from Ubuntu repositories (i.e. apt install
> openjdk-11-jdk) because the pre-installed one from TravisCI is too old, e.g.
> JDK 11.0.2 instead of 11.0.10.
> Add a job to build and test on ARM64 - a more complete version of
> https://github.com/apache/ranger/pull/91.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (RANGER-3245) Use OpenJDK in TravisCI config instead of OracleJDK
[ https://issues.apache.org/jira/browse/RANGER-3245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17419587#comment-17419587 ] Martin Tzvetanov Grigorov commented on RANGER-3245: --- I've rebased the PR an hour ago. The Travis job is scheduled but still not executed: https://app.travis-ci.com/github/apache/ranger/builds/238400141 > Use OpenJDK in TravisCI config instead of OracleJDK > --- > > Key: RANGER-3245 > URL: https://issues.apache.org/jira/browse/RANGER-3245 > Project: Ranger > Issue Type: Task > Components: build-infra >Reporter: Martin Tzvetanov Grigorov >Priority: Minor > > OpenJDK is recommended at TravisCI these days. > OracleJDK 8 is no more available for any version of Ubuntu there. > Manually install OpenJDK from Ubuntu repositories (i.e. apt install > openjdk-11-jdk) because the pre-installed one from TravisCI is too old, e.g. > JDK 11.0.2 instead of 11.0.10. > Add a job to build and test on ARM64 - a more complete version of > https://github.com/apache/ranger/pull/91. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3243) Build fails on JDK 8 and 11
[ https://issues.apache.org/jira/browse/RANGER-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17419570#comment-17419570 ] Martin Tzvetanov Grigorov commented on RANGER-3243: --- Thanks for merging it, [~rmani] ! Please also take a look at RANGER-3245: it updates .travisci.yml to test on JDK 8 and 11, on both x86_64 and arm64! This will prevent regressions in the future! > Build fails on JDK 8 and 11 > --- > > Key: RANGER-3243 > URL: https://issues.apache.org/jira/browse/RANGER-3243 > Project: Ranger > Issue Type: Task > Components: build-infra >Affects Versions: 3.0.0, 2.2.0 >Reporter: Martin Tzvetanov Grigorov >Priority: Major > Fix For: 3.0.0, 2.2.0 > > Attachments: 0001-RANGER-3243-Build-fails-on-JDK-8-and-11.patch > > Time Spent: 20m > Remaining Estimate: 0h > > The build of current master branch fails - > [https://travis-ci.com/github/apache/ranger/builds/223139469] > There are several issues: > [Issue 1|https://reviews.apache.org/r/73281/bugs/1/]) > org.apache.ranger.authorization.presto.authorizer.RangerSystemAccessControlFactory > was not able to import com.google.common.base.Throwables.throwIfUnchecked > because it was coming from an old copy of Guava's Throwables shaded in > hive-exec. > By replacing hive-exec with orc-core in agents-audit module all depending > modules use their preferred version of Guava (26.0-jre) > [Issue 2|https://reviews.apache.org/r/73281/bugs/2/]) > RangerSafenetKeySecure.java uses directly sun.security.pkcs11.SunPKCS11 - a > class that is not available in Java 9+ and this breaks the compilation. > This should use reflection to load SunPKCS11 class dynamically. > [Issue 3|https://reviews.apache.org/r/73281/bugs/3/]) JAXB is no more part of > JDK 11+ > [Issue 4|https://reviews.apache.org/r/73281/bugs/4/]) JUnit 4 > Assert.assertThat() is deprecated in favour of Hamcrest's > MatcherAssert.assertThat(). This fixes a compilation issue with JDK11. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3245) Use OpenJDK in TravisCI config instead of OracleJDK
[ https://issues.apache.org/jira/browse/RANGER-3245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17417969#comment-17417969 ] Martin Tzvetanov Grigorov commented on RANGER-3245: --- Updated the PR to latest master. > Use OpenJDK in TravisCI config instead of OracleJDK > --- > > Key: RANGER-3245 > URL: https://issues.apache.org/jira/browse/RANGER-3245 > Project: Ranger > Issue Type: Task > Components: build-infra >Reporter: Martin Tzvetanov Grigorov >Priority: Minor > > OpenJDK is recommended at TravisCI these days. > OracleJDK 8 is no more available for any version of Ubuntu there. > Manually install OpenJDK from Ubuntu repositories (i.e. apt install > openjdk-11-jdk) because the pre-installed one from TravisCI is too old, e.g. > JDK 11.0.2 instead of 11.0.10. > Add a job to build and test on ARM64 - a more complete version of > https://github.com/apache/ranger/pull/91. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3243) Build fails on JDK 8 and 11
[ https://issues.apache.org/jira/browse/RANGER-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17417951#comment-17417951 ] Martin Tzvetanov Grigorov commented on RANGER-3243: --- I've updated the PR and reviewboard to latest master. > Build fails on JDK 8 and 11 > --- > > Key: RANGER-3243 > URL: https://issues.apache.org/jira/browse/RANGER-3243 > Project: Ranger > Issue Type: Task > Components: build-infra >Reporter: Martin Tzvetanov Grigorov >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > The build of current master branch fails - > [https://travis-ci.com/github/apache/ranger/builds/223139469] > There are several issues: > [Issue 1|https://reviews.apache.org/r/73281/bugs/1/]) > org.apache.ranger.authorization.presto.authorizer.RangerSystemAccessControlFactory > was not able to import com.google.common.base.Throwables.throwIfUnchecked > because it was coming from an old copy of Guava's Throwables shaded in > hive-exec. > By replacing hive-exec with orc-core in agents-audit module all depending > modules use their preferred version of Guava (26.0-jre) > [Issue 2|https://reviews.apache.org/r/73281/bugs/2/]) > RangerSafenetKeySecure.java uses directly sun.security.pkcs11.SunPKCS11 - a > class that is not available in Java 9+ and this breaks the compilation. > This should use reflection to load SunPKCS11 class dynamically. > [Issue 3|https://reviews.apache.org/r/73281/bugs/3/]) JAXB is no more part of > JDK 11+ > [Issue 4|https://reviews.apache.org/r/73281/bugs/4/]) JUnit 4 > Assert.assertThat() is deprecated in favour of Hamcrest's > MatcherAssert.assertThat(). This fixes a compilation issue with JDK11. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3244) Update the versions of test related dependencies and Maven plugins
[ https://issues.apache.org/jira/browse/RANGER-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17417948#comment-17417948 ] Martin Tzvetanov Grigorov commented on RANGER-3244: --- I've updated the PR/reviewboard to latest master > Update the versions of test related dependencies and Maven plugins > -- > > Key: RANGER-3244 > URL: https://issues.apache.org/jira/browse/RANGER-3244 > Project: Ranger > Issue Type: Task > Components: build-infra >Reporter: Martin Tzvetanov Grigorov >Priority: Major > > Several test dependencies and Maven plugins could be updated without > affecting the build and the core functionality. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3300) Security Admin UI tests cannot run on Linux ARM64
[ https://issues.apache.org/jira/browse/RANGER-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354532#comment-17354532 ] Martin Tzvetanov Grigorov commented on RANGER-3300: --- https://reviews.apache.org/r/73392/ > Security Admin UI tests cannot run on Linux ARM64 > - > > Key: RANGER-3300 > URL: https://issues.apache.org/jira/browse/RANGER-3300 > Project: Ranger > Issue Type: Bug > Components: admin >Affects Versions: 3.0.0 >Reporter: Martin Tzvetanov Grigorov >Priority: Minor > Time Spent: 10m > Remaining Estimate: 0h > > security-admin-web UI tests fail on Linux ARM64 because they depend on > PhantomJS. > PhantomJS is not maintained since 2018 and it does not provide binary for > linux/aarch64 CPU architecture. > > I see two solutions: > 1) use [https://repo1.maven.org/maven2/com/github/liusheng/phantomjs/2.1.1/] > When building on Linux ARM64 add this library as dependency, unpack it, and > point to its aarch64 binary with PHANTOMJS_BIN=/path/to/the/unpacked/phantomjs > > 2) in my opinion a better solution would be to use headless Chromium/Firefox > instead of PhantomJS > As I said PhantomJS is not maintained since 2018 and since then there are > many changes and new features in the modern browsers -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (RANGER-3300) Security Admin UI tests cannot run on Linux ARM64
[
https://issues.apache.org/jira/browse/RANGER-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354436#comment-17354436
]
Martin Tzvetanov Grigorov edited comment on RANGER-3300 at 5/31/21, 12:33 PM:
--
1) does not work because the binary is dynamically linked and it requires extra
libraries to be pre-installed on the build machines:
{code:java}
$ ./target/phantomjs-2.1.1-linux-aarch64/bin/phantomjs --version
./target/phantomjs-2.1.1-linux-aarch64/bin/phantomjs: error while loading
shared libraries: libicui18n.so.55: cannot open shared object file: No such
file or directory{code}
Using Ubuntu's phantomjs (for aarch64) also fails with:
{code:java}
$ phantomjs --version
qt.qpa.xcb: could not connect to display qt.qpa.plugin: Could not load the Qt
platform plugin "xcb" in "" even though it was found. This application failed
to start because no Qt platform plugin could be initialized. Reinstalling the
application may fix this problem. Available platform plugins are: eglfs,
linuxfb, minimal, minimalegl, offscreen, vnc, xcb. PhantomJS has crashed.
Please read the bug reporting guide at
and file a bug report. fish:
“phantomjs --version” terminated by signal SIGABRT (Abort)
{code}
was (Author: mgrigorov):
1) does not work because the binary is dynamically linked and it requires extra
libraries to be pre-installed on the build machines:
{code:java}
$ ./target/phantomjs-2.1.1-linux-aarch64/bin/phantomjs --version
./target/phantomjs-2.1.1-linux-aarch64/bin/phantomjs: error while loading
shared libraries: libicui18n.so.55: cannot open shared object file: No such
file or directory{code}
Using Ubuntu's phantomjs (for aarch64) also fails with:
{code:java}
$ phantomjs --version qt.qpa.xcb: could not connect to display qt.qpa.plugin:
Could not load the Qt platform plugin "xcb" in "" even though it was found.
This application failed to start because no Qt platform plugin could be
initialized. Reinstalling the application may fix this problem. Available
platform plugins are: eglfs, linuxfb, minimal, minimalegl, offscreen, vnc, xcb.
PhantomJS has crashed. Please read the bug reporting guide at
and file a bug report. fish:
“phantomjs --version” terminated by signal SIGABRT (Abort)
{code}
> Security Admin UI tests cannot run on Linux ARM64
> -
>
> Key: RANGER-3300
> URL: https://issues.apache.org/jira/browse/RANGER-3300
> Project: Ranger
> Issue Type: Bug
> Components: admin
>Affects Versions: 3.0.0
>Reporter: Martin Tzvetanov Grigorov
>Priority: Minor
> Time Spent: 10m
> Remaining Estimate: 0h
>
> security-admin-web UI tests fail on Linux ARM64 because they depend on
> PhantomJS.
> PhantomJS is not maintained since 2018 and it does not provide binary for
> linux/aarch64 CPU architecture.
>
> I see two solutions:
> 1) use [https://repo1.maven.org/maven2/com/github/liusheng/phantomjs/2.1.1/]
> When building on Linux ARM64 add this library as dependency, unpack it, and
> point to its aarch64 binary with PHANTOMJS_BIN=/path/to/the/unpacked/phantomjs
>
> 2) in my opinion a better solution would be to use headless Chromium/Firefox
> instead of PhantomJS
> As I said PhantomJS is not maintained since 2018 and since then there are
> many changes and new features in the modern browsers
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (RANGER-3300) Security Admin UI tests cannot run on Linux ARM64
[
https://issues.apache.org/jira/browse/RANGER-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354436#comment-17354436
]
Martin Tzvetanov Grigorov commented on RANGER-3300:
---
1) does not work because the binary is dynamically linked and it requires extra
libraries to be pre-installed on the build machines:
{code:java}
$ ./target/phantomjs-2.1.1-linux-aarch64/bin/phantomjs --version
./target/phantomjs-2.1.1-linux-aarch64/bin/phantomjs: error while loading
shared libraries: libicui18n.so.55: cannot open shared object file: No such
file or directory{code}
Using Ubuntu's phantomjs (for aarch64) also fails with:
{code:java}
$ phantomjs --version qt.qpa.xcb: could not connect to display qt.qpa.plugin:
Could not load the Qt platform plugin "xcb" in "" even though it was found.
This application failed to start because no Qt platform plugin could be
initialized. Reinstalling the application may fix this problem. Available
platform plugins are: eglfs, linuxfb, minimal, minimalegl, offscreen, vnc, xcb.
PhantomJS has crashed. Please read the bug reporting guide at
and file a bug report. fish:
“phantomjs --version” terminated by signal SIGABRT (Abort)
{code}
> Security Admin UI tests cannot run on Linux ARM64
> -
>
> Key: RANGER-3300
> URL: https://issues.apache.org/jira/browse/RANGER-3300
> Project: Ranger
> Issue Type: Bug
> Components: admin
>Affects Versions: 3.0.0
>Reporter: Martin Tzvetanov Grigorov
>Priority: Minor
> Time Spent: 10m
> Remaining Estimate: 0h
>
> security-admin-web UI tests fail on Linux ARM64 because they depend on
> PhantomJS.
> PhantomJS is not maintained since 2018 and it does not provide binary for
> linux/aarch64 CPU architecture.
>
> I see two solutions:
> 1) use [https://repo1.maven.org/maven2/com/github/liusheng/phantomjs/2.1.1/]
> When building on Linux ARM64 add this library as dependency, unpack it, and
> point to its aarch64 binary with PHANTOMJS_BIN=/path/to/the/unpacked/phantomjs
>
> 2) in my opinion a better solution would be to use headless Chromium/Firefox
> instead of PhantomJS
> As I said PhantomJS is not maintained since 2018 and since then there are
> many changes and new features in the modern browsers
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (RANGER-3300) Security Admin UI tests cannot run on Linux ARM64
[ https://issues.apache.org/jira/browse/RANGER-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354328#comment-17354328 ] Martin Tzvetanov Grigorov commented on RANGER-3300: --- Ranger devs: Which approach do you prefer ? > Security Admin UI tests cannot run on Linux ARM64 > - > > Key: RANGER-3300 > URL: https://issues.apache.org/jira/browse/RANGER-3300 > Project: Ranger > Issue Type: Bug > Components: admin >Affects Versions: 3.0.0 >Reporter: Martin Tzvetanov Grigorov >Priority: Minor > > security-admin-web UI tests fail on Linux ARM64 because they depend on > PhantomJS. > PhantomJS is not maintained since 2018 and it does not provide binary for > linux/aarch64 CPU architecture. > > I see two solutions: > 1) use [https://repo1.maven.org/maven2/com/github/liusheng/phantomjs/2.1.1/] > When building on Linux ARM64 add this library as dependency, unpack it, and > point to its aarch64 binary with PHANTOMJS_BIN=/path/to/the/unpacked/phantomjs > > 2) in my opinion a better solution would be to use headless Chromium/Firefox > instead of PhantomJS > As I said PhantomJS is not maintained since 2018 and since then there are > many changes and new features in the modern browsers -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (RANGER-3300) Security Admin UI tests cannot run on Linux ARM64
Martin Tzvetanov Grigorov created RANGER-3300: - Summary: Security Admin UI tests cannot run on Linux ARM64 Key: RANGER-3300 URL: https://issues.apache.org/jira/browse/RANGER-3300 Project: Ranger Issue Type: Bug Components: admin Affects Versions: 3.0.0 Reporter: Martin Tzvetanov Grigorov security-admin-web UI tests fail on Linux ARM64 because they depend on PhantomJS. PhantomJS is not maintained since 2018 and it does not provide binary for linux/aarch64 CPU architecture. I see two solutions: 1) use [https://repo1.maven.org/maven2/com/github/liusheng/phantomjs/2.1.1/] When building on Linux ARM64 add this library as dependency, unpack it, and point to its aarch64 binary with PHANTOMJS_BIN=/path/to/the/unpacked/phantomjs 2) in my opinion a better solution would be to use headless Chromium/Firefox instead of PhantomJS As I said PhantomJS is not maintained since 2018 and since then there are many changes and new features in the modern browsers -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3243) Build fails on JDK 8 and 11
[
https://issues.apache.org/jira/browse/RANGER-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354296#comment-17354296
]
Martin Tzvetanov Grigorov commented on RANGER-3243:
---
JDK: build 11.0.11+9-Ubuntu-0ubuntu2.20.04
{code:java}
[INFO] Apache Ranger Distribution . SKIPPED
[INFO]
[INFO] BUILD FAILURE
[INFO]
[INFO] Total time: 01:18 min
[INFO] Finished at: 2021-05-31T09:26:59+01:00
[INFO]
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.3:compile (default-compile) on
project ranger-kms: Compilation failure
[ERROR]
/home/ubuntu/git/apache/ranger/kms/src/main/java/org/apache/hadoop/crypto/key/RangerSafenetKeySecure.java:[72,49]
error: incompatible types: String cannot be converted to Config
[ERROR]
[ERROR] -> [Help 1]
{code}
This is fixed with
https://github.com/apache/ranger/pull/96/files#diff-bc06b20fcb395424f2541febad5ba131085d2959eb99335da036f390188dd5eeR72
> Build fails on JDK 8 and 11
> ---
>
> Key: RANGER-3243
> URL: https://issues.apache.org/jira/browse/RANGER-3243
> Project: Ranger
> Issue Type: Task
> Components: build-infra
>Reporter: Martin Tzvetanov Grigorov
>Priority: Major
> Time Spent: 20m
> Remaining Estimate: 0h
>
> The build of current master branch fails -
> [https://travis-ci.com/github/apache/ranger/builds/223139469]
> There are several issues:
> [Issue 1|https://reviews.apache.org/r/73281/bugs/1/])
> org.apache.ranger.authorization.presto.authorizer.RangerSystemAccessControlFactory
> was not able to import com.google.common.base.Throwables.throwIfUnchecked
> because it was coming from an old copy of Guava's Throwables shaded in
> hive-exec.
> By replacing hive-exec with orc-core in agents-audit module all depending
> modules use their preferred version of Guava (26.0-jre)
> [Issue 2|https://reviews.apache.org/r/73281/bugs/2/])
> RangerSafenetKeySecure.java uses directly sun.security.pkcs11.SunPKCS11 - a
> class that is not available in Java 9+ and this breaks the compilation.
> This should use reflection to load SunPKCS11 class dynamically.
> [Issue 3|https://reviews.apache.org/r/73281/bugs/3/]) JAXB is no more part of
> JDK 11+
> [Issue 4|https://reviews.apache.org/r/73281/bugs/4/]) JUnit 4
> Assert.assertThat() is deprecated in favour of Hamcrest's
> MatcherAssert.assertThat(). This fixes a compilation issue with JDK11.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (RANGER-3243) Build fails on JDK 8 and 11
[ https://issues.apache.org/jira/browse/RANGER-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354279#comment-17354279 ] Martin Tzvetanov Grigorov commented on RANGER-3243: --- I was not able to find the problem, so I just disabled the example-distro module and the build passed for JDK 1.8. The only problem is with the UI build for security-admin because PhantomJS project does not provide ARM64 binaries. I will create a separate issue for this! > Build fails on JDK 8 and 11 > --- > > Key: RANGER-3243 > URL: https://issues.apache.org/jira/browse/RANGER-3243 > Project: Ranger > Issue Type: Task > Components: build-infra >Reporter: Martin Tzvetanov Grigorov >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > The build of current master branch fails - > [https://travis-ci.com/github/apache/ranger/builds/223139469] > There are several issues: > [Issue 1|https://reviews.apache.org/r/73281/bugs/1/]) > org.apache.ranger.authorization.presto.authorizer.RangerSystemAccessControlFactory > was not able to import com.google.common.base.Throwables.throwIfUnchecked > because it was coming from an old copy of Guava's Throwables shaded in > hive-exec. > By replacing hive-exec with orc-core in agents-audit module all depending > modules use their preferred version of Guava (26.0-jre) > [Issue 2|https://reviews.apache.org/r/73281/bugs/2/]) > RangerSafenetKeySecure.java uses directly sun.security.pkcs11.SunPKCS11 - a > class that is not available in Java 9+ and this breaks the compilation. > This should use reflection to load SunPKCS11 class dynamically. > [Issue 3|https://reviews.apache.org/r/73281/bugs/3/]) JAXB is no more part of > JDK 11+ > [Issue 4|https://reviews.apache.org/r/73281/bugs/4/]) JUnit 4 > Assert.assertThat() is deprecated in favour of Hamcrest's > MatcherAssert.assertThat(). This fixes a compilation issue with JDK11. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3243) Build fails on JDK 8 and 11
[
https://issues.apache.org/jira/browse/RANGER-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17354272#comment-17354272
]
Martin Tzvetanov Grigorov commented on RANGER-3243:
---
[~pradeep] I am trying to build Ranger on Linux ARM64
OS: Ubuntu 20.04.2
JDK: 1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Apache Maven 3.6.3 (cecedd343002696d0abb50b32b541b8a6ba2883f)
Ranger: current master (3af3415f6fae4f655d46ffd80dd8c2ad1c8c1dec)
Maven command: mvn clean install -DskipJSTests
Today's build fails with:
{code:java}
[INFO] --- maven-assembly-plugin:2.6:single (default) @ ranger-examples-distro
---
[INFO] Reading assembly descriptor: src/main/assembly/sampleapp.xml
[INFO] Reading assembly descriptor: src/main/assembly/plugin-sampleapp.xml
[INFO] Reading assembly descriptor: src/main/assembly/sample-client.xml
[WARNING] The following patterns were never triggered in this artifact
inclusion filter:
o 'org.apache.ranger:sampleapp'[INFO]
[INFO] Reactor Summary for Ranger Examples - SampleApp 3.0.0-SNAPSHOT:
[INFO]
[INFO] Ranger Examples - SampleApp SUCCESS [ 4.472 s]
[INFO] Ranger Examples - Ranger Plugin for SampleApp .. SUCCESS [ 4.626 s]
[INFO] sample-client .. SUCCESS [ 2.798 s]
[INFO] Apache Ranger Examples Distribution FAILURE [ 1.291 s]
[INFO] Ranger Tools ... SKIPPED
[INFO] Atlas Security Plugin .. SKIPPED
[INFO] SchemaRegistry Security Plugin . SKIPPED
[INFO] Sqoop Security Plugin .. SKIPPED
[INFO] Sqoop Security Plugin Shim . SKIPPED
[INFO] Kylin Security Plugin .. SKIPPED
[INFO] Kylin Security Plugin Shim . SKIPPED
[INFO] Presto Security Plugin . SKIPPED
[INFO] Presto Security Plugin Shim SKIPPED
[INFO] Elasticsearch Security Plugin Shim . SKIPPED
[INFO] Elasticsearch Security Plugin .. SKIPPED
[INFO] Apache Ranger Distribution . SKIPPED
[INFO]
[INFO] BUILD FAILURE
[INFO]
[INFO] Total time: 13.817 s
[INFO] Finished at: 2021-05-31T08:51:11+01:00
[INFO]
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-assembly-plugin:2.6:single (default) on project
ranger-examples-distro: Failed to create assembly: Error creating assembly
archive sampleapp: You must set at least one file. -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
{code}
I will try to solve this problem and finish the build.
After that I will paste the Maven output for JDK 11!
> Build fails on JDK 8 and 11
> ---
>
> Key: RANGER-3243
> URL: https://issues.apache.org/jira/browse/RANGER-3243
> Project: Ranger
> Issue Type: Task
> Components: build-infra
>Reporter: Martin Tzvetanov Grigorov
>Priority: Major
> Time Spent: 20m
> Remaining Estimate: 0h
>
> The build of current master branch fails -
> [https://travis-ci.com/github/apache/ranger/builds/223139469]
> There are several issues:
> [Issue 1|https://reviews.apache.org/r/73281/bugs/1/])
> org.apache.ranger.authorization.presto.authorizer.RangerSystemAccessControlFactory
> was not able to import com.google.common.base.Throwables.throwIfUnchecked
> because it was coming from an old copy of Guava's Throwables shaded in
> hive-exec.
> By replacing hive-exec with orc-core in agents-audit module all depending
> modules use their preferred version of Guava (26.0-jre)
> [Issue 2|https://reviews.apache.org/r/73281/bugs/2/])
> RangerSafenetKeySecure.java uses directly sun.security.pkcs11.SunPKCS11 - a
> class that is not available in Java 9+ and this breaks the compilation.
> This should use reflection to load SunPKCS11 class dynamically.
> [Issue 3|https://reviews.apache.org/r/73281/bugs/3/]) JAXB is no more part of
> JDK 11+
> [Issue 4|https://reviews.apache.org/r/73281/bugs/4/]) JUnit 4
> Assert.assertThat() is deprecated in favour of Hamcrest's
> MatcherAssert.assertThat(). This fixes a compilation issue with JDK11.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (RANGER-3245) Use OpenJDK in TravisCI config instead of OracleJDK
[ https://issues.apache.org/jira/browse/RANGER-3245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17342398#comment-17342398 ] Martin Tzvetanov Grigorov commented on RANGER-3245: --- Hello Ranger devs, do you have any feedback on the proposed improvements ? > Use OpenJDK in TravisCI config instead of OracleJDK > --- > > Key: RANGER-3245 > URL: https://issues.apache.org/jira/browse/RANGER-3245 > Project: Ranger > Issue Type: Task > Components: build-infra >Reporter: Martin Tzvetanov Grigorov >Priority: Minor > > OpenJDK is recommended at TravisCI these days. > OracleJDK 8 is no more available for any version of Ubuntu there. > Manually install OpenJDK from Ubuntu repositories (i.e. apt install > openjdk-11-jdk) because the pre-installed one from TravisCI is too old, e.g. > JDK 11.0.2 instead of 11.0.10. > Add a job to build and test on ARM64 - a more complete version of > https://github.com/apache/ranger/pull/91. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3244) Update the versions of test related dependencies and Maven plugins
[ https://issues.apache.org/jira/browse/RANGER-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17342397#comment-17342397 ] Martin Tzvetanov Grigorov commented on RANGER-3244: --- Hello Ranger devs, do you have any feedback on the proposed updates ? > Update the versions of test related dependencies and Maven plugins > -- > > Key: RANGER-3244 > URL: https://issues.apache.org/jira/browse/RANGER-3244 > Project: Ranger > Issue Type: Task > Components: build-infra >Reporter: Martin Tzvetanov Grigorov >Priority: Major > > Several test dependencies and Maven plugins could be updated without > affecting the build and the core functionality. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3243) Build fails on JDK 8 and 11
[ https://issues.apache.org/jira/browse/RANGER-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17342395#comment-17342395 ] Martin Tzvetanov Grigorov commented on RANGER-3243: --- Hello Ranger devs, do you have any feedback on the proposed improvements ? > Build fails on JDK 8 and 11 > --- > > Key: RANGER-3243 > URL: https://issues.apache.org/jira/browse/RANGER-3243 > Project: Ranger > Issue Type: Task > Components: build-infra >Reporter: Martin Tzvetanov Grigorov >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > The build of current master branch fails - > [https://travis-ci.com/github/apache/ranger/builds/223139469] > There are several issues: > [Issue 1|https://reviews.apache.org/r/73281/bugs/1/]) > org.apache.ranger.authorization.presto.authorizer.RangerSystemAccessControlFactory > was not able to import com.google.common.base.Throwables.throwIfUnchecked > because it was coming from an old copy of Guava's Throwables shaded in > hive-exec. > By replacing hive-exec with orc-core in agents-audit module all depending > modules use their preferred version of Guava (26.0-jre) > [Issue 2|https://reviews.apache.org/r/73281/bugs/2/]) > RangerSafenetKeySecure.java uses directly sun.security.pkcs11.SunPKCS11 - a > class that is not available in Java 9+ and this breaks the compilation. > This should use reflection to load SunPKCS11 class dynamically. > [Issue 3|https://reviews.apache.org/r/73281/bugs/3/]) JAXB is no more part of > JDK 11+ > [Issue 4|https://reviews.apache.org/r/73281/bugs/4/]) JUnit 4 > Assert.assertThat() is deprecated in favour of Hamcrest's > MatcherAssert.assertThat(). This fixes a compilation issue with JDK11. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3243) Build fails on JDK 8 and 11
[ https://issues.apache.org/jira/browse/RANGER-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17335204#comment-17335204 ] Martin Tzvetanov Grigorov commented on RANGER-3243: --- Thanks for the update here, [~chia7712] ! I've updated [https://reviews.apache.org/r/73281/] by rebasing it to latest master. Now it contains only the fixes for 2), 3) and 4). > Build fails on JDK 8 and 11 > --- > > Key: RANGER-3243 > URL: https://issues.apache.org/jira/browse/RANGER-3243 > Project: Ranger > Issue Type: Task > Components: build-infra >Reporter: Martin Tzvetanov Grigorov >Priority: Major > > The build of current master branch fails - > [https://travis-ci.com/github/apache/ranger/builds/223139469] > There are several issues: > [Issue 1|https://reviews.apache.org/r/73281/bugs/1/]) > org.apache.ranger.authorization.presto.authorizer.RangerSystemAccessControlFactory > was not able to import com.google.common.base.Throwables.throwIfUnchecked > because it was coming from an old copy of Guava's Throwables shaded in > hive-exec. > By replacing hive-exec with orc-core in agents-audit module all depending > modules use their preferred version of Guava (26.0-jre) > [Issue 2|https://reviews.apache.org/r/73281/bugs/2/]) > RangerSafenetKeySecure.java uses directly sun.security.pkcs11.SunPKCS11 - a > class that is not available in Java 9+ and this breaks the compilation. > This should use reflection to load SunPKCS11 class dynamically. > [Issue 3|https://reviews.apache.org/r/73281/bugs/3/]) JAXB is no more part of > JDK 11+ > [Issue 4|https://reviews.apache.org/r/73281/bugs/4/]) JUnit 4 > Assert.assertThat() is deprecated in favour of Hamcrest's > MatcherAssert.assertThat(). This fixes a compilation issue with JDK11. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3161) Support building and testing Ranger on ARM64 platform
[ https://issues.apache.org/jira/browse/RANGER-3161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324983#comment-17324983 ] Martin Tzvetanov Grigorov commented on RANGER-3161: --- I've created https://issues.apache.org/jira/browse/RANGER-3245 with some further improvements in the TravisCI config for both x86_64 and aarch64. > Support building and testing Ranger on ARM64 platform > - > > Key: RANGER-3161 > URL: https://issues.apache.org/jira/browse/RANGER-3161 > Project: Ranger > Issue Type: Improvement > Components: Ranger >Reporter: liusheng >Priority: Minor > Time Spent: 10m > Remaining Estimate: 0h > > Currently, there are many softwares have support running on ARM64 platform. > We have also done many efforts about making big-data projects support ARM64 > platform. > For an example, Hadoop has published ARM64 platform specific packages: > [https://www.apache.org/dyn/closer.cgi/hadoop/common/hadoop-3.3.0/hadoop-3.3.0-aarch64.tar.gz] > > and also have ARM specific CI job configured: > [https://ci-hadoop.apache.org/job/Hive-trunk-linux-ARM/] > It would be better to also enable ARM support and setup ARM CI for Ranger > project -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (RANGER-3245) Use OpenJDK in TravisCI config instead of OracleJDK
[ https://issues.apache.org/jira/browse/RANGER-3245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Tzvetanov Grigorov updated RANGER-3245: -- Description: OpenJDK is recommended at TravisCI these days. OracleJDK 8 is no more available for any version of Ubuntu there. Manually install OpenJDK from Ubuntu repositories (i.e. apt install openjdk-11-jdk) because the pre-installed one from TravisCI is too old, e.g. JDK 11.0.2 instead of 11.0.10. Add a job to build and test on ARM64 - a more complete version of https://github.com/apache/ranger/pull/91. was: OpenJDK is recommended at TravisCI these days. OracleJDK 8 is no more available for any version of Ubuntu there > Use OpenJDK in TravisCI config instead of OracleJDK > --- > > Key: RANGER-3245 > URL: https://issues.apache.org/jira/browse/RANGER-3245 > Project: Ranger > Issue Type: Task > Components: build-infra >Reporter: Martin Tzvetanov Grigorov >Priority: Minor > > OpenJDK is recommended at TravisCI these days. > OracleJDK 8 is no more available for any version of Ubuntu there. > Manually install OpenJDK from Ubuntu repositories (i.e. apt install > openjdk-11-jdk) because the pre-installed one from TravisCI is too old, e.g. > JDK 11.0.2 instead of 11.0.10. > Add a job to build and test on ARM64 - a more complete version of > https://github.com/apache/ranger/pull/91. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3245) Use OpenJDK in TravisCI config instead of OracleJDK
[
https://issues.apache.org/jira/browse/RANGER-3245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17323793#comment-17323793
]
Martin Tzvetanov Grigorov commented on RANGER-3245:
---
I even tried with JDK 16 but there are tests failures:
{code:java}
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 s
- in org.apache.ranger.plugin.policyengine.TestRangerAuthContext
[INFO]
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR]
TestPolicyEngine.testPolicyEngine_geo:318->runTestsFromResourceFiles:457->runTests:574->runTestCaseTests:668
isAllowed mismatched! - DENY 'read /finance/restricted/sales.db' for
g=finance; invalid clientIPAddress expected: but was:
[ERROR]
TestPolicyEngine.testPolicyEngine_hdfs:193->runTestsFromResourceFiles:457->runTests:574->runTestCaseTests:668
isAllowed mismatched! - DENY 'read /finance/restricted/sales.db' for
g=finance; invalid clientIPAddress expected: but was:
[ERROR]
TestPolicyEngine.testPolicyEngine_hdfs_allaudit:200->runTestsFromResourceFiles:457->runTests:574->runTestCaseTests:668
isAllowed mismatched! - DENY 'read /finance/restricted/sales.db' for
g=finance; invalid clientIPAddress expected: but was:
[ERROR]
TestPolicyEngine.testPolicyEngine_hdfs_noaudit:207->runTestsFromResourceFiles:457->runTests:574->runTestCaseTests:668
isAllowed mismatched! - DENY 'read /finance/restricted/sales.db' for
g=finance; invalid clientIPAddress expected: but was:
[ERROR]
TestPolicyEngine.testPolicyEngine_hiveForTag:269->runTestsFromResourceFiles:457->runTests:574->runTestCaseTests:668
isAllowed mismatched! - ALLOW 'select ssn from employee.personal;' for user1
using EXPIRES_ON tag expected: but was:
[ERROR]
TestPolicyEngine.testPolicyEngine_hiveForTag_filebased:325->runTestsFromResourceFiles:457->runTests:574->runTestCaseTests:668
isAllowed mismatched! - ALLOW 'select ssn from employee.personal;' for user1
using EXPIRES_ON tag expected: but was:
[INFO]
[ERROR] Tests run: 207, Failures: 6, Errors: 0, Skipped: 0
{code}
Please let me know if you want me to add JDK16 to the matrix! This way these
test failures will be addressed sooner!
> Use OpenJDK in TravisCI config instead of OracleJDK
> ---
>
> Key: RANGER-3245
> URL: https://issues.apache.org/jira/browse/RANGER-3245
> Project: Ranger
> Issue Type: Task
> Components: build-infra
>Reporter: Martin Tzvetanov Grigorov
>Priority: Minor
>
> OpenJDK is recommended at TravisCI these days.
> OracleJDK 8 is no more available for any version of Ubuntu there
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (RANGER-3245) Use OpenJDK in TravisCI config instead of OracleJDK
[ https://issues.apache.org/jira/browse/RANGER-3245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17323786#comment-17323786 ] Martin Tzvetanov Grigorov commented on RANGER-3245: --- https://reviews.apache.org/r/73283/ > Use OpenJDK in TravisCI config instead of OracleJDK > --- > > Key: RANGER-3245 > URL: https://issues.apache.org/jira/browse/RANGER-3245 > Project: Ranger > Issue Type: Task > Components: build-infra >Reporter: Martin Tzvetanov Grigorov >Priority: Minor > > OpenJDK is recommended at TravisCI these days. > OracleJDK 8 is no more available for any version of Ubuntu there -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (RANGER-3245) Use OpenJDK in TravisCI config instead of OracleJDK
Martin Tzvetanov Grigorov created RANGER-3245: - Summary: Use OpenJDK in TravisCI config instead of OracleJDK Key: RANGER-3245 URL: https://issues.apache.org/jira/browse/RANGER-3245 Project: Ranger Issue Type: Task Components: build-infra Reporter: Martin Tzvetanov Grigorov OpenJDK is recommended at TravisCI these days. OracleJDK 8 is no more available for any version of Ubuntu there -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3244) Update the versions of test related dependencies and Maven plugins
[ https://issues.apache.org/jira/browse/RANGER-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17322724#comment-17322724 ] Martin Tzvetanov Grigorov commented on RANGER-3244: --- https://reviews.apache.org/r/73282/ > Update the versions of test related dependencies and Maven plugins > -- > > Key: RANGER-3244 > URL: https://issues.apache.org/jira/browse/RANGER-3244 > Project: Ranger > Issue Type: Task > Components: build-infra >Reporter: Martin Tzvetanov Grigorov >Priority: Major > > Several test dependencies and Maven plugins could be updated without > affecting the build and the core functionality. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (RANGER-3244) Update the versions of test related dependencies and Maven plugins
Martin Tzvetanov Grigorov created RANGER-3244: - Summary: Update the versions of test related dependencies and Maven plugins Key: RANGER-3244 URL: https://issues.apache.org/jira/browse/RANGER-3244 Project: Ranger Issue Type: Task Components: build-infra Reporter: Martin Tzvetanov Grigorov Several test dependencies and Maven plugins could be updated without affecting the build and the core functionality. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (RANGER-3243) Build fails on JDK 8 and 11
[ https://issues.apache.org/jira/browse/RANGER-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17322721#comment-17322721 ] Martin Tzvetanov Grigorov commented on RANGER-3243: --- https://reviews.apache.org/r/73281/ > Build fails on JDK 8 and 11 > --- > > Key: RANGER-3243 > URL: https://issues.apache.org/jira/browse/RANGER-3243 > Project: Ranger > Issue Type: Task > Components: build-infra >Reporter: Martin Tzvetanov Grigorov >Priority: Major > > The build of current master branch fails - > [https://travis-ci.com/github/apache/ranger/builds/223139469] > There are several issues: > [Issue 1|https://reviews.apache.org/r/73281/bugs/1/]) > org.apache.ranger.authorization.presto.authorizer.RangerSystemAccessControlFactory > was not able to import com.google.common.base.Throwables.throwIfUnchecked > because it was coming from an old copy of Guava's Throwables shaded in > hive-exec. > By replacing hive-exec with orc-core in agents-audit module all depending > modules use their preferred version of Guava (26.0-jre) > [Issue 2|https://reviews.apache.org/r/73281/bugs/2/]) > RangerSafenetKeySecure.java uses directly sun.security.pkcs11.SunPKCS11 - a > class that is not available in Java 9+ and this breaks the compilation. > This should use reflection to load SunPKCS11 class dynamically. > [Issue 3|https://reviews.apache.org/r/73281/bugs/3/]) JAXB is no more part of > JDK 11+ > [Issue 4|https://reviews.apache.org/r/73281/bugs/4/]) JUnit 4 > Assert.assertThat() is deprecated in favour of Hamcrest's > MatcherAssert.assertThat(). This fixes a compilation issue with JDK11. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (RANGER-3243) Build fails on JDK 8 and 11
Martin Tzvetanov Grigorov created RANGER-3243: - Summary: Build fails on JDK 8 and 11 Key: RANGER-3243 URL: https://issues.apache.org/jira/browse/RANGER-3243 Project: Ranger Issue Type: Task Components: build-infra Reporter: Martin Tzvetanov Grigorov The build of current master branch fails - [https://travis-ci.com/github/apache/ranger/builds/223139469] There are several issues: [Issue 1|https://reviews.apache.org/r/73281/bugs/1/]) org.apache.ranger.authorization.presto.authorizer.RangerSystemAccessControlFactory was not able to import com.google.common.base.Throwables.throwIfUnchecked because it was coming from an old copy of Guava's Throwables shaded in hive-exec. By replacing hive-exec with orc-core in agents-audit module all depending modules use their preferred version of Guava (26.0-jre) [Issue 2|https://reviews.apache.org/r/73281/bugs/2/]) RangerSafenetKeySecure.java uses directly sun.security.pkcs11.SunPKCS11 - a class that is not available in Java 9+ and this breaks the compilation. This should use reflection to load SunPKCS11 class dynamically. [Issue 3|https://reviews.apache.org/r/73281/bugs/3/]) JAXB is no more part of JDK 11+ [Issue 4|https://reviews.apache.org/r/73281/bugs/4/]) JUnit 4 Assert.assertThat() is deprecated in favour of Hamcrest's MatcherAssert.assertThat(). This fixes a compilation issue with JDK11. -- This message was sent by Atlassian Jira (v8.3.4#803005)
