Darshan Mehta created ZEPPELIN-2709:
---------------------------------------
Summary: Zeppelin 0.7.1 : isloated mode for interpreter throws
NullPointerException
Key: ZEPPELIN-2709
URL: https://issues.apache.org/jira/browse/ZEPPELIN-2709
Project: Zeppelin
Issue Type: Bug
Reporter: Darshan Mehta
Zeppelin version : 0.7.1 (emr-5.6.0)
Authentication mechanism : Apache Shiro
I am running Zeppelin in interpreter configured to run in isolated mode per
user (attached "Interpreter.JPG"). While trying to run the first paragraph of
same note with two different users, first user sees sucess response whereas
second user sees ERROR with NullPointerException, below is the stacktrace:
{code:java}
java.lang.NullPointerException
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33)
at
org.apache.zeppelin.spark.SparkInterpreter.createSparkContext_2(SparkInterpreter.java:391)
at
org.apache.zeppelin.spark.SparkInterpreter.createSparkContext(SparkInterpreter.java:380)
at
org.apache.zeppelin.spark.SparkInterpreter.getSparkContext(SparkInterpreter.java:146)
at
org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:828)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:483)
at org.apache.zeppelin.scheduler.Job.run(Job.java:175)
at
org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
{code}
On restart, same behavior is observed. Interpreter works fine for first user
and throws NPE for second (resulting in hung zeppelin process on cluster) enen
though both the users are not running the same paragraph simultaneously. I have
tried with different combinations for modes per note and per user and have seen
the same behavior. The only mode that works for all the users is Global mode.
Steps to reproduce:
- Spin up an EMR(5.6.0) cluster with Zeppelin 0.7.1 and shiro authentication
- Log into Zeppelin, go to interpreter settings and change the Spark
interpreter to run in isolated mode per user
- Try running a paragraph of same note with different users
- First user will see success response whereas second user will see ERROR
Expected behavior:
- Both the users should be able to run paragraphs successfully, regardless of
the mode
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
