[jira] [Commented] (SPARK-18451) Always set -XX:+HeapDumpOnOutOfMemoryError for Spark tests
[
https://issues.apache.org/jira/browse/SPARK-18451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223846#comment-16223846
]
Xin Lu commented on SPARK-18451:
Pretty easy to do if we can get the jenkins job builder scripts changed and
there is a place to dump the files on amplab jenkins/s3
> Always set -XX:+HeapDumpOnOutOfMemoryError for Spark tests
> --
>
> Key: SPARK-18451
> URL: https://issues.apache.org/jira/browse/SPARK-18451
> Project: Spark
> Issue Type: Bug
> Components: Build, Tests
>Reporter: Cheng Lian
>
> It would be nice if we always set {{-XX:+HeapDumpOnOutOfMemoryError}} and
> {{-XX:+HeapDumpPath}} for open source Spark tests. So that it would be easier
> to investigate issues like SC-5041.
> Note:
> - We need to ensure that the heap dumps are stored in a location on Jenkins
> that won't be automatically cleaned up.
> - It would be nice to be able to customize the customize the heap dump output
> paths on a per build basis so that it's easier to find the heap dump file of
> any given build.
> The 2nd point is optional since we can probably identify wanted heap dump
> files by looking at the creation timestamp.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-18451) Always set -XX:+HeapDumpOnOutOfMemoryError for Spark tests
[
https://issues.apache.org/jira/browse/SPARK-18451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033904#comment-16033904
]
Dongjoon Hyun commented on SPARK-18451:
---
Hi, [~lian cheng].
Shall we remove the target version here if Jenkins doesn't have these options?
> Always set -XX:+HeapDumpOnOutOfMemoryError for Spark tests
> --
>
> Key: SPARK-18451
> URL: https://issues.apache.org/jira/browse/SPARK-18451
> Project: Spark
> Issue Type: Bug
> Components: Build, Tests
>Reporter: Cheng Lian
>
> It would be nice if we always set {{-XX:+HeapDumpOnOutOfMemoryError}} and
> {{-XX:+HeapDumpPath}} for open source Spark tests. So that it would be easier
> to investigate issues like SC-5041.
> Note:
> - We need to ensure that the heap dumps are stored in a location on Jenkins
> that won't be automatically cleaned up.
> - It would be nice to be able to customize the customize the heap dump output
> paths on a per build basis so that it's easier to find the heap dump file of
> any given build.
> The 2nd point is optional since we can probably identify wanted heap dump
> files by looking at the creation timestamp.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
