Yesha Vora created SPARK-16541:
----------------------------------
Summary: SparkTC application could not shutdown successfully
Key: SPARK-16541
URL: https://issues.apache.org/jira/browse/SPARK-16541
Project: Spark
Issue Type: Bug
Affects Versions: 2.0.0
Reporter: Yesha Vora
SparkTC application in yarn-client mode was stuck at 10% progress.
{code} spark-submit --class org.apache.spark.examples.SparkTC --master
yarn-client spark-examples-assembly_*.jar {code}
It seems like SparkTC application tasks finished and printed "TC has 6254
edges.". after that while shutting down, spark application kept getting "ERROR
LiveListenerBus: SparkListenerBus has already stopped! Dropping event
SparkListenerExecutorMetricsUpdate"
{code}
16/07/13 08:43:37 INFO DAGScheduler: ResultStage 283 (count at
SparkTC.scala:71) finished in 42.357 s
16/07/13 08:43:37 INFO DAGScheduler: Job 13 finished: count at
SparkTC.scala:71, took 43.137408 s
TC has 6254 edges.
16/07/13 08:43:37 INFO ServerConnector: Stopped
ServerConnector@5e0054a2{HTTP/1.1}{0.0.0.0:4040}
16/07/13 08:43:37 INFO ContextHandler: Stopped
o.s.j.s.ServletContextHandler@7350a22{/stages/stage/kill,null,UNAVAILABLE}
16/07/13 08:43:37 INFO ContextHandler: Stopped
o.s.j.s.ServletContextHandler@54d56a49{/api,null,UNAVAILABLE}
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
