[jira] [Issue Comment Deleted] (SPARK-1112) When spark.akka.frameSize > 10, task results bigger than 10MiB block execution

2014-06-18 Thread Chen Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Jin updated SPARK-1112: Comment: was deleted (was: Awesome, looking forward to the fix. ) > When spark.akka.frameSize > 10, task r

[jira] [Commented] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

2014-06-18 Thread Chen Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036903#comment-14036903 ] Chen Jin commented on SPARK-2156: - [~pwendell] [~mengxr][~gq], Thanks a lot, I will give i

[jira] [Commented] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

2014-06-18 Thread Chen Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036863#comment-14036863 ] Chen Jin commented on SPARK-2156: - Yes, I am calling collect() at the end. > When the si

[jira] [Commented] (SPARK-1112) When spark.akka.frameSize > 10, task results bigger than 10MiB block execution

2014-06-18 Thread Chen Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036843#comment-14036843 ] Chen Jin commented on SPARK-1112: - Awesome, looking forward to the fix. At least better er

[jira] [Commented] (SPARK-1112) When spark.akka.frameSize > 10, task results bigger than 10MiB block execution

2014-06-18 Thread Chen Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036840#comment-14036840 ] Chen Jin commented on SPARK-1112: - Awesome, looking forward to the fix. > When spark.akk

[jira] [Commented] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

2014-06-18 Thread Chen Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036822#comment-14036822 ] Chen Jin commented on SPARK-2156: - [~gq] Thanks a lot for looking into this. The differenc

[jira] [Commented] (SPARK-1112) When spark.akka.frameSize > 10, task results bigger than 10MiB block execution

2014-06-18 Thread Chen Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036704#comment-14036704 ] Chen Jin commented on SPARK-1112: - I have filed a bug https://issues.apache.org/jira/brows

[jira] [Updated] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

2014-06-18 Thread Chen Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Jin updated SPARK-2156: Description: I have done some experiments when the frameSize is around 10MB . 1) spark.akka.frameSize = 1

[jira] [Updated] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

2014-06-16 Thread Chen Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Jin updated SPARK-2156: Summary: When the size of serialized results for one partition is slightly smaller than 10MB (the default a

[jira] [Created] (SPARK-2156) When serialized results for any partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

2014-06-16 Thread Chen Jin (JIRA)
Chen Jin created SPARK-2156: --- Summary: When serialized results for any partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks Key: SPARK-2156 URL: https://issues.apache.org/jira/brows

[jira] [Commented] (SPARK-1112) When spark.akka.frameSize > 10, task results bigger than 10MiB block execution

2014-06-16 Thread Chen Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14032867#comment-14032867 ] Chen Jin commented on SPARK-1112: - To follow up this thread, I have done some experiments

[jira] [Commented] (SPARK-1112) When spark.akka.frameSize > 10, task results bigger than 10MiB block execution

2014-06-13 Thread Chen Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031307#comment-14031307 ] Chen Jin commented on SPARK-1112: - [~matei] Do you know which akka version we should use t