[
https://issues.apache.org/jira/browse/SPARK-13851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
t7s updated SPARK-13851:
------------------------
Description:
!try.png!
env: yarn 2.3.0-cdh5.1.0
--master yarn-cluster
--conf "spark.driver.cores=2"
--conf "spark.akka.threads=16"
I am sure these job completed according to the log
For example, job 9816
This is info about job 9816 in log:
[2016-03-14 07:15:05,088] INFO Job 9816 finished: transform at
ErrorStreaming2.scala:396, took 8.218500 s
(org.apache.spark.scheduler.DAGScheduler)
Stages in job 9816 are completed too according to the log
But job 9816 is still in active job of web ui, why?
How can I clear these remaining jobs?
was:
!http://apache-spark-user-list.1001560.n3.nabble.com/file/n26474/34%E5%B1%8F%E5%B9%95%E6%88%AA%E5%9B%BE.png!
env: yarn 2.3.0-cdh5.1.0
--master yarn-cluster
--conf "spark.driver.cores=2"
--conf "spark.akka.threads=16"
I am sure these job completed according to the log
For example, job 9816
This is info about job 9816 in log:
[2016-03-14 07:15:05,088] INFO Job 9816 finished: transform at
ErrorStreaming2.scala:396, took 8.218500 s
(org.apache.spark.scheduler.DAGScheduler)
Stages in job 9816 are completed too according to the log
But job 9816 is still in active job of web ui, why?
How can I clear these remaining jobs?
> spark streaming web ui remains completed jobs as active jobs
> ------------------------------------------------------------
>
> Key: SPARK-13851
> URL: https://issues.apache.org/jira/browse/SPARK-13851
> Project: Spark
> Issue Type: Bug
> Components: Streaming
> Affects Versions: 1.4.1
> Environment: yarn 2.3.0-cdh5.1.0
> Reporter: t7s
> Priority: Minor
> Attachments: try.png
>
>
> !try.png!
> env: yarn 2.3.0-cdh5.1.0
> --master yarn-cluster
> --conf "spark.driver.cores=2"
> --conf "spark.akka.threads=16"
> I am sure these job completed according to the log
> For example, job 9816
> This is info about job 9816 in log:
> [2016-03-14 07:15:05,088] INFO Job 9816 finished: transform at
> ErrorStreaming2.scala:396, took 8.218500 s
> (org.apache.spark.scheduler.DAGScheduler)
> Stages in job 9816 are completed too according to the log
> But job 9816 is still in active job of web ui, why?
> How can I clear these remaining jobs?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
