[GitHub] spark pull request #23158: [SPARK-26186][SPARK-26184] Last updated time is n...

[shahidki31]

GitHub user shahidki31 opened a pull request:

    https://github.com/apache/spark/pull/23158

    [SPARK-26186][SPARK-26184] Last updated time is not getting updated for the 
Inprogress application

    ## What changes were proposed in this pull request?
    
    When the 'spark.history.fs.inProgressOptimization.enabled' is true, 
inProgress application's last updated time is not getting updated in the 
History UI. Also, during the cleaning time, InProgress application is getting 
removed from the listing, even if the last updated time is within the cleaning 
threshold time.
    
    ## How was this patch tested?
    Added UT, attached screen shot.
    Before patch:
    ![screenshot from 2018-11-27 
23-22-38](https://user-images.githubusercontent.com/23054875/49101600-9b5a3380-f29c-11e8-8efc-3fb594e4279a.png)
    ![screenshot from 2018-11-27 
23-20-11](https://user-images.githubusercontent.com/23054875/49101601-9c8b6080-f29c-11e8-928e-643a8c8f4477.png)
    
    
    After Patch:
    ![screenshot from 2018-11-27 
23-37-10](https://user-images.githubusercontent.com/23054875/49101911-669aac00-f29d-11e8-8181-663e4a08ab0e.png)
    ![screenshot from 2018-11-27 
23-39-04](https://user-images.githubusercontent.com/23054875/49102010-a5306680-f29d-11e8-947a-e8a2a09a785a.png)
    


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/shahidki31/spark HistoryLastUpdateTime

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/23158.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #23158
    
----
commit 985470c0e12a3c67df47b5174748652c6e6f6e57
Author: Shahid <shahidki31@...>
Date:   2018-11-27T13:32:58Z

    update lastUpdateTime for inprogress application

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org