[GitHub] spark issue #14673: [SPARK-15083] [Web UI] History Server can OOM due to unl...

[ajbozarth]

Github user ajbozarth commented on the issue:

    https://github.com/apache/spark/pull/14673
  
    Found a odd behavior while testing. When a application encounters an issue 
(in my case my task queue filled up and SparkListenerBus was stopped) it can 
cause the tasks HashMap size to be larger than the sum of completed, failed, 
and active tasks (total tasks). This means that the UI can end up looking like 
the following two screen shots (of the same application). If everyone can agree 
this is a separate issue from this I will file a JIRA for it for later.
    
    with `spark.ui.trimTasks` true:
    ![screen shot 2016-08-16 at 2 29 07 
pm](https://cloud.githubusercontent.com/assets/13952758/17716514/d2dc7d88-63bd-11e6-8821-0cbcc41033b8.png)
    
    with `spark.ui.trimTasks` false:
    ![screen shot 2016-08-16 at 2 20 40 
pm](https://cloud.githubusercontent.com/assets/13952758/17716496/c522ecf4-63bd-11e6-8bd1-a922f9fa00b4.png)



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org