Github user mfelgamal commented on the issue:
https://github.com/apache/zeppelin/pull/1538
@astroshim sorry for the belated response. I worked on fixing the issue of
zeppelin version 0.6.It's solved by installing scala on the docker. This issue
only happens with the binary version downloaded from zeppelin website, but when
creating an image from create_release.sh script, it worked normally without
scala installation requirement.
The logs of the issue:
```
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:823)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.lang.reflect.Method.invoke(Method.java:606)
org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38)
org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33)
org.apache.zeppelin.spark.SparkInterpreter.createSparkSession(SparkInterpreter.java:333)
org.apache.zeppelin.spark.SparkInterpreter.getSparkSession(SparkInterpreter.java:216)
org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:741)
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:341)
org.apache.zeppelin.scheduler.Job.run(Job.java:176)
org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
java.util.concurrent.FutureTask.run(FutureTask.java:262)
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
INFO [2016-11-12 19:43:16,282] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Running Spark version 2.0.0
WARN [2016-11-12 19:43:16,283] ({pool-1-thread-3}
Logging.scala[logWarning]:66) -
SPARK_CLASSPATH was detected (set to
':/usr/local/zeppelin/interpreter/spark/dep/*:/usr/local/zeppelin/interpreter/spark/*::/usr/local/zeppelin/lib/zeppelin-interpreter-0.6.1.jar').
This is deprecated in Spark 1.0+.
Please instead use:
- ./spark-submit with --driver-class-path to augment the driver classpath
- spark.executor.extraClassPath to augment the executor classpath
WARN [2016-11-12 19:43:16,284] ({pool-1-thread-3}
Logging.scala[logWarning]:66) - Setting 'spark.executor.extraClassPath' to
':/usr/local/zeppelin/interpreter/spark/dep/*:/usr/local/zeppelin/interpreter/spark/*::/usr/local/zeppelin/lib/zeppelin-interpreter-0.6.1.jar'
as a work-around.
WARN [2016-11-12 19:43:16,284] ({pool-1-thread-3}
Logging.scala[logWarning]:66) - Setting 'spark.driver.extraClassPath' to
':/usr/local/zeppelin/interpreter/spark/dep/*:/usr/local/zeppelin/interpreter/spark/*::/usr/local/zeppelin/lib/zeppelin-interpreter-0.6.1.jar'
as a work-around.
INFO [2016-11-12 19:43:16,285] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Changing view acls to: root
INFO [2016-11-12 19:43:16,285] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Changing modify acls to: root
INFO [2016-11-12 19:43:16,285] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Changing view acls groups to:
INFO [2016-11-12 19:43:16,285] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Changing modify acls groups to:
INFO [2016-11-12 19:43:16,285] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - SecurityManager: authentication disabled; ui acls
disabled; users with view permissions: Set(root); groups with view
permissions: Set(); users with modify permissions: Set(root); groups with
modify permissions: Set()
INFO [2016-11-12 19:43:16,308] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Successfully started service 'sparkDriver' on port
33780.
INFO [2016-11-12 19:43:16,310] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Registering MapOutputTracker
INFO [2016-11-12 19:43:16,311] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Registering BlockManagerMaster
INFO [2016-11-12 19:43:16,312] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Created local directory at
/tmp/blockmgr-19543a72-27a1-4490-a96f-c8295f1454f0
INFO [2016-11-12 19:43:16,313] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - MemoryStore started with capacity 409.2 MB
INFO [2016-11-12 19:43:16,314] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Registering OutputCommitCoordinator
INFO [2016-11-12 19:43:16,474] ({pool-1-thread-3}
Server.java[doStart]:327) - jetty-9.2.z-SNAPSHOT
INFO [2016-11-12 19:43:16,476] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@da42cfd{/jobs,null,AVAILABLE}
INFO [2016-11-12 19:43:16,476] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@15859d0a{/jobs/json,null,AVAILABLE}
INFO [2016-11-12 19:43:16,477] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@7709068f{/jobs/job,null,AVAILABLE}
INFO [2016-11-12 19:43:16,477] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@718dd356{/jobs/job/json,null,AVAILABLE}
INFO [2016-11-12 19:43:16,477] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@162ded58{/stages,null,AVAILABLE}
INFO [2016-11-12 19:43:16,478] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@213937c8{/stages/json,null,AVAILABLE}
INFO [2016-11-12 19:43:16,478] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@337d3c82{/stages/stage,null,AVAILABLE}
INFO [2016-11-12 19:43:16,478] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@630f9536{/stages/stage/json,null,AVAILABLE}
INFO [2016-11-12 19:43:16,478] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@140d3f09{/stages/pool,null,AVAILABLE}
INFO [2016-11-12 19:43:16,479] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@71a57227{/stages/pool/json,null,AVAILABLE}
INFO [2016-11-12 19:43:16,479] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@24e998bb{/storage,null,AVAILABLE}
INFO [2016-11-12 19:43:16,479] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@642a2feb{/storage/json,null,AVAILABLE}
INFO [2016-11-12 19:43:16,480] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@db020ad{/storage/rdd,null,AVAILABLE}
INFO [2016-11-12 19:43:16,480] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@263144e0{/storage/rdd/json,null,AVAILABLE}
INFO [2016-11-12 19:43:16,480] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@6ca0e1b6{/environment,null,AVAILABLE}
INFO [2016-11-12 19:43:16,481] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@3642ab71{/environment/json,null,AVAILABLE}
INFO [2016-11-12 19:43:16,481] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@5305a38b{/executors,null,AVAILABLE}
INFO [2016-11-12 19:43:16,481] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@17342542{/executors/json,null,AVAILABLE}
INFO [2016-11-12 19:43:16,481] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@607a1bf4{/executors/threadDump,null,AVAILABLE}
INFO [2016-11-12 19:43:16,482] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@70c161a7{/executors/threadDump/json,null,AVAILABLE}
INFO [2016-11-12 19:43:16,482] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@27f254c6{/static,null,AVAILABLE}
INFO [2016-11-12 19:43:16,482] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@169ba7a7{/,null,AVAILABLE}
INFO [2016-11-12 19:43:16,483] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@451bd089{/api,null,AVAILABLE}
INFO [2016-11-12 19:43:16,483] ({pool-1-thread-3}
ContextHandler.java[doStart]:744) - Started
o.s.j.s.ServletContextHandler@2517f5d1{/stages/stage/kill,null,AVAILABLE}
INFO [2016-11-12 19:43:16,484] ({pool-1-thread-3}
AbstractConnector.java[doStart]:266) - Started
ServerConnector@1ed2d23f{HTTP/1.1}{0.0.0.0:4040}
INFO [2016-11-12 19:43:16,484] ({pool-1-thread-3}
Server.java[doStart]:379) - Started @6886ms
INFO [2016-11-12 19:43:16,484] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Successfully started service 'SparkUI' on port
4040.
INFO [2016-11-12 19:43:16,485] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Bound SparkUI to 0.0.0.0, and started at
http://localhost:4040
INFO [2016-11-12 19:43:16,518] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Copying
/usr/local/zeppelin/interpreter/spark/pyspark/pyspark.zip to
/tmp/spark-ff3df8f1-4e1a-4fd1-bff9-c761a801e26d/userFiles-816bf19b-f8f5-4e66-90ca-f994cba0aec4/pyspark.zip
INFO [2016-11-12 19:43:16,520] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Added file
file:/usr/local/zeppelin/interpreter/spark/pyspark/pyspark.zip at
file:/usr/local/zeppelin/interpreter/spark/pyspark/pyspark.zip with timestamp
1478979796518
INFO [2016-11-12 19:43:16,521] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Copying
/usr/local/zeppelin/interpreter/spark/pyspark/py4j-0.10.1-src.zip to
/tmp/spark-ff3df8f1-4e1a-4fd1-bff9-c761a801e26d/userFiles-816bf19b-f8f5-4e66-90ca-f994cba0aec4/py4j-0.10.1-src.zip
INFO [2016-11-12 19:43:16,522] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Added file
file:/usr/local/zeppelin/interpreter/spark/pyspark/py4j-0.10.1-src.zip at
file:/usr/local/zeppelin/interpreter/spark/pyspark/py4j-0.10.1-src.zip with
timestamp 1478979796521
INFO [2016-11-12 19:43:16,526] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Created default pool default, schedulingMode:
FIFO, minShare: 0, weight: 1
INFO [2016-11-12 19:43:16,526] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Starting executor ID driver on host localhost
ERROR [2016-11-12 19:43:16,527] ({pool-1-thread-3}
Logging.scala[logError]:91) - Error initializing SparkContext.
java.util.NoSuchElementException: next on empty iterator
at scala.collection.Iterator$$anon$2.next(Iterator.scala:39)
at scala.collection.Iterator$$anon$2.next(Iterator.scala:37)
at scala.collection.IndexedSeqLike$Elements.next(IndexedSeqLike.scala:63)
at scala.collection.IterableLike$class.head(IterableLike.scala:107)
at
scala.collection.mutable.ArrayOps$ofRef.scala$collection$IndexedSeqOptimized$$super$head(ArrayOps.scala:186)
at
scala.collection.IndexedSeqOptimized$class.head(IndexedSeqOptimized.scala:126)
at scala.collection.mutable.ArrayOps$ofRef.head(ArrayOps.scala:186)
at scala.collection.TraversableLike$class.last(TraversableLike.scala:431)
at
scala.collection.mutable.ArrayOps$ofRef.scala$collection$IndexedSeqOptimized$$super$last(ArrayOps.scala:186)
at
scala.collection.IndexedSeqOptimized$class.last(IndexedSeqOptimized.scala:132)
at scala.collection.mutable.ArrayOps$ofRef.last(ArrayOps.scala:186)
at
org.apache.spark.executor.Executor$$anonfun$createClassLoader$1.apply(Executor.scala:422)
at
org.apache.spark.executor.Executor$$anonfun$createClassLoader$1.apply(Executor.scala:421)
at scala.collection.immutable.List.foreach(List.scala:381)
at
org.apache.spark.executor.Executor.createClassLoader(Executor.scala:421)
at org.apache.spark.executor.Executor.<init>(Executor.scala:98)
at
org.apache.spark.scheduler.local.LocalEndpoint.<init>(LocalSchedulerBackend.scala:59)
at
org.apache.spark.scheduler.local.LocalSchedulerBackend.start(LocalSchedulerBackend.scala:126)
at
org.apache.spark.scheduler.TaskSchedulerImpl.start(TaskSchedulerImpl.scala:149)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:500)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2256)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$8.apply(SparkSession.scala:831)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$8.apply(SparkSession.scala:823)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:823)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33)
at
org.apache.zeppelin.spark.SparkInterpreter.createSparkSession(SparkInterpreter.java:333)
at
org.apache.zeppelin.spark.SparkInterpreter.getSparkSession(SparkInterpreter.java:216)
at
org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:741)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.getProgress(LazyOpenInterpreter.java:110)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer.getProgress(RemoteInterpreterServer.java:404)
at
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Processor$getProgress.getResult(RemoteInterpreterService.java:1509)
at
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Processor$getProgress.getResult(RemoteInterpreterService.java:1494)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
INFO [2016-11-12 19:43:16,528] ({pool-1-thread-3}
AbstractConnector.java[doStop]:306) - Stopped
ServerConnector@1ed2d23f{HTTP/1.1}{0.0.0.0:4040}
INFO [2016-11-12 19:43:16,529] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@2517f5d1{/stages/stage/kill,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,529] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@451bd089{/api,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,529] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@169ba7a7{/,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,530] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@27f254c6{/static,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,530] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@70c161a7{/executors/threadDump/json,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,530] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@607a1bf4{/executors/threadDump,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,531] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@17342542{/executors/json,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,531] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@5305a38b{/executors,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,531] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@3642ab71{/environment/json,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,531] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@6ca0e1b6{/environment,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,532] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@263144e0{/storage/rdd/json,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,532] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@db020ad{/storage/rdd,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,532] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@642a2feb{/storage/json,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,532] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@24e998bb{/storage,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,533] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@71a57227{/stages/pool/json,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,533] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@140d3f09{/stages/pool,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,533] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@630f9536{/stages/stage/json,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,533] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@337d3c82{/stages/stage,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,534] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@213937c8{/stages/json,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,534] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@162ded58{/stages,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,534] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@718dd356{/jobs/job/json,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,534] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@7709068f{/jobs/job,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,535] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@15859d0a{/jobs/json,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,535] ({pool-1-thread-3}
ContextHandler.java[doStop]:865) - Stopped
o.s.j.s.ServletContextHandler@da42cfd{/jobs,null,UNAVAILABLE}
INFO [2016-11-12 19:43:16,535] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Stopped Spark web UI at http://localhost:4040
ERROR [2016-11-12 19:43:16,536] ({pool-1-thread-3}
Logging.scala[logError]:91) - Uncaught exception in thread pool-1-thread-3
java.lang.NullPointerException
at
org.apache.spark.scheduler.local.LocalSchedulerBackend.org$apache$spark$scheduler$local$LocalSchedulerBackend$$stop(LocalSchedulerBackend.scala:158)
at
org.apache.spark.scheduler.local.LocalSchedulerBackend.stop(LocalSchedulerBackend.scala:137)
at
org.apache.spark.scheduler.TaskSchedulerImpl.stop(TaskSchedulerImpl.scala:452)
at org.apache.spark.scheduler.DAGScheduler.stop(DAGScheduler.scala:1601)
at
org.apache.spark.SparkContext$$anonfun$stop$8.apply$mcV$sp(SparkContext.scala:1779)
at org.apache.spark.util.Utils$.tryLogNonFatalError(Utils.scala:1267)
at org.apache.spark.SparkContext.stop(SparkContext.scala:1778)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:568)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2256)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$8.apply(SparkSession.scala:831)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$8.apply(SparkSession.scala:823)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:823)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33)
at
org.apache.zeppelin.spark.SparkInterpreter.createSparkSession(SparkInterpreter.java:333)
at
org.apache.zeppelin.spark.SparkInterpreter.getSparkSession(SparkInterpreter.java:216)
at
org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:741)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.getProgress(LazyOpenInterpreter.java:110)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer.getProgress(RemoteInterpreterServer.java:404)
at
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Processor$getProgress.getResult(RemoteInterpreterService.java:1509)
at
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Processor$getProgress.getResult(RemoteInterpreterService.java:1494)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
INFO [2016-11-12 19:43:16,536] ({dispatcher-event-loop-1}
Logging.scala[logInfo]:54) - MapOutputTrackerMasterEndpoint stopped!
INFO [2016-11-12 19:43:16,537] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - MemoryStore cleared
INFO [2016-11-12 19:43:16,537] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - BlockManager stopped
INFO [2016-11-12 19:43:16,538] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - BlockManagerMaster stopped
WARN [2016-11-12 19:43:16,538] ({pool-1-thread-3}
Logging.scala[logWarning]:66) - Stopping a MetricsSystem that is not running
INFO [2016-11-12 19:43:16,538] ({dispatcher-event-loop-6}
Logging.scala[logInfo]:54) - OutputCommitCoordinator stopped!
INFO [2016-11-12 19:43:16,540] ({pool-1-thread-3}
Logging.scala[logInfo]:54) - Successfully stopped SparkContext
ERROR [2016-11-12 19:43:16,540] ({pool-1-thread-3}
Utils.java[invokeMethod]:40) -
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33)
at
org.apache.zeppelin.spark.SparkInterpreter.createSparkSession(SparkInterpreter.java:333)
at
org.apache.zeppelin.spark.SparkInterpreter.getSparkSession(SparkInterpreter.java:216)
at
org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:741)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.getProgress(LazyOpenInterpreter.java:110)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer.getProgress(RemoteInterpreterServer.java:404)
at
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Processor$getProgress.getResult(RemoteInterpreterService.java:1509)
at
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Processor$getProgress.getResult(RemoteInterpreterService.java:1494)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.NoSuchElementException: next on empty iterator
at scala.collection.Iterator$$anon$2.next(Iterator.scala:39)
at scala.collection.Iterator$$anon$2.next(Iterator.scala:37)
at scala.collection.IndexedSeqLike$Elements.next(IndexedSeqLike.scala:63)
at scala.collection.IterableLike$class.head(IterableLike.scala:107)
at
scala.collection.mutable.ArrayOps$ofRef.scala$collection$IndexedSeqOptimized$$super$head(ArrayOps.scala:186)
at
scala.collection.IndexedSeqOptimized$class.head(IndexedSeqOptimized.scala:126)
at scala.collection.mutable.ArrayOps$ofRef.head(ArrayOps.scala:186)
at scala.collection.TraversableLike$class.last(TraversableLike.scala:431)
at
scala.collection.mutable.ArrayOps$ofRef.scala$collection$IndexedSeqOptimized$$super$last(ArrayOps.scala:186)
at
scala.collection.IndexedSeqOptimized$class.last(IndexedSeqOptimized.scala:132)
at scala.collection.mutable.ArrayOps$ofRef.last(ArrayOps.scala:186)
at
org.apache.spark.executor.Executor$$anonfun$createClassLoader$1.apply(Executor.scala:422)
at
org.apache.spark.executor.Executor$$anonfun$createClassLoader$1.apply(Executor.scala:421)
at scala.collection.immutable.List.foreach(List.scala:381)
at
org.apache.spark.executor.Executor.createClassLoader(Executor.scala:421)
at org.apache.spark.executor.Executor.<init>(Executor.scala:98)
at
org.apache.spark.scheduler.local.LocalEndpoint.<init>(LocalSchedulerBackend.scala:59)
at
org.apache.spark.scheduler.local.LocalSchedulerBackend.start(LocalSchedulerBackend.scala:126)
at
org.apache.spark.scheduler.TaskSchedulerImpl.start(TaskSchedulerImpl.scala:149)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:500)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2256)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$8.apply(SparkSession.scala:831)
at
org.apache.spark.sql.SparkSession$Builder$$anonfun$8.apply(SparkSession.scala:823)
at scala.Option.getOrElse(Option.scala:121)
at
org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:823)
... 20 more
INFO [2016-11-12 19:43:16,541] ({pool-1-thread-3}
SparkInterpreter.java[createSparkSession]:334) - Created Spark session with
Hive support
ERROR [2016-11-12 19:43:16,541] ({pool-1-thread-3}
TThreadPoolServer.java[run]:296) - Error occurred during processing of message.
java.lang.NullPointerException
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33)
at
org.apache.zeppelin.spark.SparkInterpreter.createSparkContext_2(SparkInterpreter.java:363)
at
org.apache.zeppelin.spark.SparkInterpreter.createSparkContext(SparkInterpreter.java:352)
at
org.apache.zeppelin.spark.SparkInterpreter.getSparkContext(SparkInterpreter.java:137)
at
org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:743)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
at
org.apache.zeppelin.interpreter.LazyOpenInterpreter.getProgress(LazyOpenInterpreter.java:110)
at
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer.getProgress(RemoteInterpreterServer.java:404)
at
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Processor$getProgress.getResult(RemoteInterpreterService.java:1509)
at
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Processor$getProgress.getResult(RemoteInterpreterService.java:1494)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
