[
https://issues.apache.org/jira/browse/RANGER-4418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17783881#comment-17783881
]
Anatoly commented on RANGER-4418:
---------------------------------
I tried to configure Ranger with Hadoop 3.3.6 using your changes and I get an
error when building
how can this be fixed?
{code:java}
[INFO] T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.ranger.services.hdfs.RangerHdfsAuthorizerTest
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further
details.
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.615 s
- in org.apache.ranger.services.hdfs.RangerHdfsAuthorizerTest
[INFO] Running org.apache.ranger.services.hdfs.client.HdfsClientTest
[INFO] Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 s
- in org.apache.ranger.services.hdfs.client.HdfsClientTest
[INFO] Running org.apache.ranger.services.hdfs.HDFSRangerTest
[ERROR] Tests run: 2, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 3.946 s
<<< FAILURE! - in org.apache.ranger.services.hdfs.HDFSRangerTest
[ERROR] org.apache.ranger.services.hdfs.HDFSRangerTest Time elapsed: 3.944 s
<<< ERROR!
java.lang.NoClassDefFoundError: org/eclipse/jetty/servlet/ServletContextHandler
at
org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:966)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:778)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:1033)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:1008)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1782)
at
org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1390)
at
org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1159)
at
org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:1032)
at
org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:964)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:588)
at
org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:530)
at
org.apache.ranger.services.hdfs.HDFSRangerTest.setup(HDFSRangerTest.java:65)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:377)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:284)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:248)
at
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:167)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:456)
at
org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:169)
at
org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:595)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:581)
Caused by: java.lang.ClassNotFoundException:
org.eclipse.jetty.servlet.ServletContextHandler
at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
... 32 more
[ERROR] org.apache.ranger.services.hdfs.HDFSRangerTest Time elapsed: 3.944 s
<<< ERROR!
java.lang.NullPointerException
at
org.apache.ranger.services.hdfs.HDFSRangerTest.cleanup(HDFSRangerTest.java:72)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.RunAfters.invokeMethod(RunAfters.java:46)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:377)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:284)
at
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:248)
at
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:167)
at
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:456)
at
org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:169)
at
org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:595)
at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:581)
[INFO]
[INFO] Results:
[INFO]
[ERROR] Errors:
[ERROR] org.apache.ranger.services.hdfs.HDFSRangerTest.null
[ERROR] Run 1: HDFSRangerTest.setup:65 » NoClassDefFound
org/eclipse/jetty/servlet/ServletContextHandler
[ERROR] Run 2: HDFSRangerTest.cleanup:72 NullPointer
[INFO]
[INFO]
[ERROR] Tests run: 19, Failures: 0, Errors: 1, Skipped: 0
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for ranger 3.0.0-SNAPSHOT:
[INFO]
[INFO] ranger ............................................. SUCCESS [ 11.395 s]
[INFO] Jdbc SQL Connector ................................. SUCCESS [ 18.998 s]
[INFO] Credential Support ................................. SUCCESS [ 14.227 s]
[INFO] Audit Component .................................... SUCCESS [ 49.380 s]
[INFO] ranger-plugin-classloader .......................... SUCCESS [ 21.601 s]
[INFO] Common library for Plugins ......................... SUCCESS [02:18 min]
[INFO] ranger-intg ........................................ SUCCESS [ 33.070 s]
[INFO] Installer Support Component ........................ SUCCESS [ 12.534 s]
[INFO] Credential Builder ................................. SUCCESS [ 20.035 s]
[INFO] Embedded Web Server Invoker ........................ SUCCESS [ 29.904 s]
[INFO] Ranger HA Common Library ........................... SUCCESS [ 22.921 s]
[INFO] ranger-metrics ..................................... SUCCESS [ 27.419 s]
[INFO] Key Management Service ............................. SUCCESS [01:22 min]
[INFO] HBase Security Plugin Shim ......................... SUCCESS [33:46 min]
[INFO] HBase Security Plugin .............................. SUCCESS [ 34.935 s]
[INFO] Hdfs Security Plugin ............................... FAILURE [ 14.921 s]
[INFO] Hive Security Plugin ............................... SKIPPED
[INFO] Knox Security Plugin Shim .......................... SKIPPED
[INFO] Knox Security Plugin ............................... SKIPPED
[INFO] Storm Security Plugin .............................. SKIPPED
[INFO] YARN Security Plugin ............................... SKIPPED
[INFO] Ozone Security Plugin .............................. SKIPPED
[INFO] Ranger Util ........................................ SKIPPED
[INFO] Unix Authentication Client ......................... SKIPPED
[INFO] User Group Synchronizer Util ....................... SKIPPED
[INFO] ranger-authn ....................................... SKIPPED
[INFO] Security Admin Web Application ..................... SKIPPED
[INFO] KAFKA Security Plugin .............................. SKIPPED
[INFO] SOLR Security Plugin ............................... SKIPPED
[INFO] NiFi Security Plugin ............................... SKIPPED
[INFO] NiFi Registry Security Plugin ...................... SKIPPED
[INFO] Kudu Security Plugin ............................... SKIPPED
[INFO] Unix User Group Synchronizer ....................... SKIPPED
[INFO] Ldap Config Check Tool ............................. SKIPPED
[INFO] Unix Authentication Service ........................ SKIPPED
[INFO] Unix Native Authenticator .......................... SKIPPED
[INFO] KMS Security Plugin ................................ SKIPPED
[INFO] Tag Synchronizer ................................... SKIPPED
[INFO] Hdfs Security Plugin Shim .......................... SKIPPED
[INFO] Hive Security Plugin Shim .......................... SKIPPED
[INFO] YARN Security Plugin Shim .......................... SKIPPED
[INFO] OZONE Security Plugin Shim ......................... SKIPPED
[INFO] Storm Security Plugin shim ......................... SKIPPED
[INFO] KAFKA Security Plugin Shim ......................... SKIPPED
[INFO] SOLR Security Plugin Shim .......................... SKIPPED
[INFO] Atlas Security Plugin Shim ......................... SKIPPED
[INFO] KMS Security Plugin Shim ........................... SKIPPED
[INFO] ranger-examples .................................... SKIPPED
[INFO] Ranger Examples - Conditions and ContextEnrichers .. SKIPPED
[INFO] Ranger Examples - SampleApp ........................ SKIPPED
[INFO] Ranger Examples - Ranger Plugin for SampleApp ...... SKIPPED
[INFO] sample-client ...................................... SKIPPED
[INFO] Apache Ranger Examples Distribution ................ SKIPPED
[INFO] Ranger Tools ....................................... SKIPPED
[INFO] Atlas Security Plugin .............................. SKIPPED
[INFO] SchemaRegistry Security Plugin ..................... SKIPPED
[INFO] Sqoop Security Plugin .............................. SKIPPED
[INFO] Sqoop Security Plugin Shim ......................... SKIPPED
[INFO] Kylin Security Plugin .............................. SKIPPED
[INFO] Kylin Security Plugin Shim ......................... SKIPPED
[INFO] Presto Security Plugin ............................. SKIPPED
[INFO] Presto Security Plugin Shim ........................ SKIPPED
[INFO] Elasticsearch Security Plugin Shim ................. SKIPPED
[INFO] Elasticsearch Security Plugin ...................... SKIPPED
[INFO] Apache Ranger Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 42:40 min
[INFO] Finished at: 2023-11-08T07:18:38+03:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:3.0.0-M6:test (default-test) on
project ranger-hdfs-plugin:
[ERROR]
[ERROR] Please refer to
/home/user1/r300-2-4418/ranger/hdfs-agent/target/surefire-reports for the
individual test results.
[ERROR] Please refer to dump files (if any exist) [date].dump,
[date]-jvmRun[N].dump and [date].dumpstream.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <args> -rf :ranger-hdfs-plugin
{code}
> Upgrade hadoop version and use shaded hadoop client artifacts
> -------------------------------------------------------------
>
> Key: RANGER-4418
> URL: https://issues.apache.org/jira/browse/RANGER-4418
> Project: Ranger
> Issue Type: Improvement
> Components: Ranger
> Affects Versions: 2.3.0, 2.4.0
> Reporter: YUBI LEE
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> - Upgrade the hadoop version Ranger uses.
> - Try to use shaded hadoop client artifacts if possible.
> Related issue: https://issues.apache.org/jira/browse/HADOOP-11804
> If shaded hadoop client artifacts ({{hadoop-client-api}},
> {{hadoop-client-runtime}}) are used, Ranger will be free to use any version
> of thirdparty libraries without collision.
> I will make a pull request soon.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
