Hi,
-not sure if my 1st email has reached the mailing list, I just subscribed to
the list a few minutes ago-
I'm trying to use Zeppelin 0.10.1 in Docker and store notebooks on HDFS from
our Hadoop cluster.
Nevertheless, as soon as I set :
<property>
<name>zeppelin.notebook.storage</name>
<value>org.apache.zeppelin.notebook.repo.FileSystemNotebookRepo</value>
<description>notebook persistence layer implementation</description>
</property>
in zeppelin-site.xml, the workload is not able to start. The stacktrace is as
follow :
INFO [2022-12-02 15:23:23,296] ({main} Server.java[doStart]:400) - Started
@2191ms
ERROR [2022-12-02 15:23:23,296] ({main} ZeppelinServer.java[main]:262) - Error
while running jettyServer
java.lang.Exception: A MultiException has 2 exceptions. They are:
1. java.lang.NoClassDefFoundError:
org/apache/hadoop/security/UserGroupInformation
2. java.lang.IllegalStateException: Unable to perform operation: create on
org.apache.zeppelin.notebook.repo.NotebookRepoSync
at
org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:256)
Caused by: A MultiException has 2 exceptions. They are:
1. java.lang.NoClassDefFoundError:
org/apache/hadoop/security/UserGroupInformation
2. java.lang.IllegalStateException: Unable to perform operation: create on
org.apache.zeppelin.notebook.repo.NotebookRepoSync
at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:368)
at
org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:463)
at
org.glassfish.hk2.utilities.ImmediateContext.findOrCreate(ImmediateContext.java:111)
at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2102)
at
org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:93)
at
org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:67)
at
org.glassfish.hk2.utilities.ImmediateContext.doWork(ImmediateContext.java:290)
at
org.glassfish.hk2.internal.ImmediateHelper.run(ImmediateHelper.java:233)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Caused by: java.lang.NoClassDefFoundError:
org/apache/hadoop/security/UserGroupInformation
at
org.apache.zeppelin.notebook.FileSystemStorage.<clinit>(FileSystemStorage.java:42)
at
org.apache.zeppelin.notebook.repo.FileSystemNotebookRepo.init(FileSystemNotebookRepo.java:51)
at
org.apache.zeppelin.notebook.repo.NotebookRepoSync.init(NotebookRepoSync.java:83)
at
org.apache.zeppelin.notebook.repo.NotebookRepoSync.<init>(NotebookRepoSync.java:62)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at
org.glassfish.hk2.utilities.reflection.ReflectionHelper.makeMe(ReflectionHelper.java:1356)
at org.jvnet.hk2.internal.ClazzCreator.createMe(ClazzCreator.java:248)
at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:342)
... 10 more
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.security.UserGroupInformation
at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
... 21 more
I have built the project from sources, but same error. I have also tried to
explicitly add Hadoop-common dependency in the pom of NotebookRepo, but same
error again at runtime.
What am I making wrong ?
Best regards
Julian BLIN
Data Intelligence
[email protected]<mailto:[email protected]>
+352 2424 2067
POST Group
20, rue de Reims L-2417 Luxembourg
www.post.lu<http://www.post.lu/>