[jira] [Closed] (SPARK-14367) spark.memory.useLegacyMode=true in 1.6 does not yield the same memory behavior as Spark 1.3

2016-04-11 Thread Tom Hubregtsen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom Hubregtsen closed SPARK-14367. -- Resolution: Not A Bug useLegacyMode works as expected, I just made a wrong assumption >

[jira] [Commented] (SPARK-14367) spark.memory.useLegacyMode=true in 1.6 does not yield the same memory behavior as Spark 1.3

2016-04-11 Thread Tom Hubregtsen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15235623#comment-15235623 ] Tom Hubregtsen commented on SPARK-14367: Sorry, let me be more precise. I can now get the

[jira] [Commented] (SPARK-14367) spark.memory.useLegacyMode=true in 1.6 does not yield the same memory behavior as Spark 1.3

2016-04-11 Thread Tom Hubregtsen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15235457#comment-15235457 ] Tom Hubregtsen commented on SPARK-14367: Thanks, I am now able to get the old behavior when I

[jira] [Updated] (SPARK-14367) spark.memory.useLegacyMode=true in 1.6 does not yield the same memory behavior as Spark 1.3

2016-04-04 Thread Tom Hubregtsen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom Hubregtsen updated SPARK-14367: --- Labels: backwards-compatibility (was: ) > spark.memory.useLegacyMode=true in 1.6 does not

[jira] [Updated] (SPARK-14367) spark.memory.useLegacyMode=true in 1.6 does not yield the same memory behavior as Spark 1.3

2016-04-04 Thread Tom Hubregtsen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom Hubregtsen updated SPARK-14367: --- Summary: spark.memory.useLegacyMode=true in 1.6 does not yield the same memory behavior as

[jira] [Created] (SPARK-14367) spark.memory.useLegacyMode=true in 1.6 does not yield the same memory behavior as in 1.3

2016-04-04 Thread Tom Hubregtsen (JIRA)
Tom Hubregtsen created SPARK-14367: -- Summary: spark.memory.useLegacyMode=true in 1.6 does not yield the same memory behavior as in 1.3 Key: SPARK-14367 URL: https://issues.apache.org/jira/browse/SPARK-14367

[jira] [Commented] (SPARK-3577) Add task metric to report spill time

2015-07-15 Thread Tom Hubregtsen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628646#comment-14628646 ] Tom Hubregtsen commented on SPARK-3577: --- I could also use this metric Add task

[jira] [Comment Edited] (SPARK-7002) Persist on RDD fails the second time if the action is called on a child RDD without showing a FAILED message

2015-04-20 Thread Tom Hubregtsen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503730#comment-14503730 ] Tom Hubregtsen edited comment on SPARK-7002 at 4/20/15 9:46 PM:

[jira] [Commented] (SPARK-7002) Persist on RDD fails the second time if the action is called on a child RDD without showing a FAILED message

2015-04-20 Thread Tom Hubregtsen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503730#comment-14503730 ] Tom Hubregtsen commented on SPARK-7002: --- Your speculation was correct: After the

[jira] [Commented] (SPARK-7002) Persist on RDD fails the second time if the action is called on a child RDD without showing a FAILED message

2015-04-20 Thread Tom Hubregtsen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503783#comment-14503783 ] Tom Hubregtsen commented on SPARK-7002: --- Great, thanks for your help :) I will be

[jira] [Updated] (SPARK-7002) Persist on RDD fails the second time if the action is called on a child RDD without showing a FAILED message

2015-04-19 Thread Tom Hubregtsen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom Hubregtsen updated SPARK-7002: -- Description: The major issue is: Persist on RDD fails the second time if the action is called

[jira] [Updated] (SPARK-7002) Persist on RDD fails the second time if the action is called on a child RDD without showing a FAILED message

2015-04-19 Thread Tom Hubregtsen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom Hubregtsen updated SPARK-7002: -- Description: The major issue is: Persist on RDD fails the second time if the action is called

[jira] [Updated] (SPARK-7002) Persist on RDD fails the second time if the action is called on a child RDD without showing a FAILED message

2015-04-19 Thread Tom Hubregtsen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom Hubregtsen updated SPARK-7002: -- Description: The major issue is: Persist on RDD fails the second time if the action is called

[jira] [Created] (SPARK-7002) Persist on RDD fails the second time if the action is called on a child RDD without showing a FAILED message

2015-04-19 Thread Tom Hubregtsen (JIRA)
Tom Hubregtsen created SPARK-7002: - Summary: Persist on RDD fails the second time if the action is called on a child RDD without showing a FAILED message Key: SPARK-7002 URL:

[jira] [Commented] (SPARK-7002) Persist on RDD fails the second time if the action is called on a child RDD without showing a FAILED message

2015-04-19 Thread Tom Hubregtsen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14502329#comment-14502329 ] Tom Hubregtsen commented on SPARK-7002: --- I disagree. I first also thought it was