[ 
https://issues.apache.org/jira/browse/SPARK-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aaron Davidson resolved SPARK-2147.
-----------------------------------

    Resolution: Fixed

https://github.com/apache/spark/pull/1102

> Master UI forgets about Executors when application exits cleanly
> ----------------------------------------------------------------
>
>                 Key: SPARK-2147
>                 URL: https://issues.apache.org/jira/browse/SPARK-2147
>             Project: Spark
>          Issue Type: Bug
>          Components: Web UI
>    Affects Versions: 1.0.0
>            Reporter: Aaron Davidson
>            Assignee: Andrew Or
>
> When an application exits cleanly, the Master will remove all executors from 
> the application's ApplicationInfo, causing the historic "Completed 
> Applications" page to report that there were no executors associated with 
> that application. 
> On the contrary, if the application exits uncleanly, then the Master will 
> remove the application FIRST, and will not actually remove the executors from 
> the ApplicationInfo page. This causes the executors to show up correctly in 
> the "Completed Applications" page.
> The correct behavior would probably be to gather a history of all executors 
> (so we'd retain executors that we had at one point but were removed during 
> the job), and not remove lost executors.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to