[ 
https://issues.apache.org/jira/browse/SPARK-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067306#comment-14067306
 ] 

Masayoshi TSUZUKI commented on SPARK-2567:
------------------------------------------

I found this lines in log file.
{noformat}
14/07/17 18:07:36 DEBUG DAGScheduler: Stage Stage 1 is actually done; true 3 3
{noformat}
so I think this is because extra stage which has no tasks to be executed is 
submitted, and then SparkListenerStageSubmitted is called but 
SparkListenerStageCompleted is not called.

> Resubmitted stage sometimes remains as active stage in the web UI
> -----------------------------------------------------------------
>
>                 Key: SPARK-2567
>                 URL: https://issues.apache.org/jira/browse/SPARK-2567
>             Project: Spark
>          Issue Type: Bug
>            Reporter: Masayoshi TSUZUKI
>         Attachments: SPARK-2567.png
>
>
> When a stage is resubmitted because of executor lost for example, sometimes 
> more than one resubmitted task appears in the web UI and one stage remains as 
> active even after the job has finished.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to