t7s created SPARK-13851:
---------------------------
Summary: spark streaming web ui remains completed jobs as active
jobs
Key: SPARK-13851
URL: https://issues.apache.org/jira/browse/SPARK-13851
Project: Spark
Issue Type: Bug
Components: Streaming
Affects Versions: 1.4.1
Environment: yarn 2.3.0-cdh5.1.0
Reporter: t7s
Priority: Minor
!http://apache-spark-user-list.1001560.n3.nabble.com/file/n26474/34%E5%B1%8F%E5%B9%95%E6%88%AA%E5%9B%BE.png!
env: yarn 2.3.0-cdh5.1.0
--master yarn-cluster
--conf "spark.driver.cores=2"
--conf "spark.akka.threads=16"
I am sure these job completed according to the log
For example, job 9816
This is info about job 9816 in log:
[2016-03-14 07:15:05,088] INFO Job 9816 finished: transform at
ErrorStreaming2.scala:396, took 8.218500 s
(org.apache.spark.scheduler.DAGScheduler)
Stages in job 9816 are completed too according to the log
But job 9816 is still in active job of web ui, why?
How can I clear these remaining jobs?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
