[jira] [Updated] (SPARK-15083) History Server would OOM due to unlimited TaskUIData in some stages

[ https://issues.apache.org/jira/browse/SPARK-15083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Tan updated SPARK-15083: -- Summary: History Server would OOM due to unlimited TaskUIData in some stages (was:

[jira] [Updated] (SPARK-15083) JobProgressListener should limit memory usage of tasks in stages.

[ https://issues.apache.org/jira/browse/SPARK-15083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Tan updated SPARK-15083: -- Attachment: Screen Shot 2016-05-01 at 3.50.02 PM.png Screen Shot 2016-05-01 at 3.51.01

[jira] [Created] (SPARK-15083) JobProgressListener should limit memory usage of tasks in stages.

Zheng Tan created SPARK-15083: - Summary: JobProgressListener should limit memory usage of tasks in stages. Key: SPARK-15083 URL: https://issues.apache.org/jira/browse/SPARK-15083 Project: Spark

[jira] [Commented] (SPARK-15059) Fine-grained class loader lock in ChildFirstURLClassLoader caused dead locks

[ https://issues.apache.org/jira/browse/SPARK-15059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15267752#comment-15267752 ] Zheng Tan commented on SPARK-15059: --- Yes, we have removed it in our product environment, and it works

[jira] [Commented] (SPARK-15060) Fix stack overflow when executing long lineage transform without checkpoint

[ https://issues.apache.org/jira/browse/SPARK-15060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15266832#comment-15266832 ] Zheng Tan commented on SPARK-15060: --- 1) We can serialize rdd to binary without dependency info(save

[jira] [Updated] (SPARK-15060) Fix stack overflow when executing long lineage transform without checkpoint

[ https://issues.apache.org/jira/browse/SPARK-15060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Tan updated SPARK-15060: -- Summary: Fix stack overflow when executing long lineage transform without checkpoint (was: Fix stack

[jira] [Commented] (SPARK-15060) Fix stack overflow when executing long linage transform without checkpoint

[ https://issues.apache.org/jira/browse/SPARK-15060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15266601#comment-15266601 ] Zheng Tan commented on SPARK-15060: --- RDDs are linked by their dependencies: In the above example,

[jira] [Created] (SPARK-15060) Fix stack overflow when executing long linage transform without checkpoint

Zheng Tan created SPARK-15060: - Summary: Fix stack overflow when executing long linage transform without checkpoint Key: SPARK-15060 URL: https://issues.apache.org/jira/browse/SPARK-15060 Project: Spark

[jira] [Created] (SPARK-15059) Fine-grained class loader lock in ChildFirstURLClassLoader caused dead locks

Zheng Tan created SPARK-15059: - Summary: Fine-grained class loader lock in ChildFirstURLClassLoader caused dead locks Key: SPARK-15059 URL: https://issues.apache.org/jira/browse/SPARK-15059 Project: