[
https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chen Jin updated SPARK-1112:
Comment: was deleted
(was: Awesome, looking forward to the fix. )
> When spark.akka.frameSize > 10, task r
[
https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036903#comment-14036903
]
Chen Jin commented on SPARK-2156:
-
[~pwendell] [~mengxr][~gq], Thanks a lot, I will give i
[
https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036863#comment-14036863
]
Chen Jin commented on SPARK-2156:
-
Yes, I am calling collect() at the end.
> When the si
[
https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036843#comment-14036843
]
Chen Jin commented on SPARK-1112:
-
Awesome, looking forward to the fix. At least better er
[
https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036840#comment-14036840
]
Chen Jin commented on SPARK-1112:
-
Awesome, looking forward to the fix.
> When spark.akk
[
https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036822#comment-14036822
]
Chen Jin commented on SPARK-2156:
-
[~gq] Thanks a lot for looking into this. The differenc
[
https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036704#comment-14036704
]
Chen Jin commented on SPARK-1112:
-
I have filed a bug https://issues.apache.org/jira/brows
[
https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chen Jin updated SPARK-2156:
Description:
I have done some experiments when the frameSize is around 10MB .
1) spark.akka.frameSize = 1
[
https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chen Jin updated SPARK-2156:
Summary: When the size of serialized results for one partition is slightly
smaller than 10MB (the default a
Chen Jin created SPARK-2156:
---
Summary: When serialized results for any partition is slightly
smaller than 10MB (the default akka.frameSize), the execution blocks
Key: SPARK-2156
URL: https://issues.apache.org/jira/brows
[
https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14032867#comment-14032867
]
Chen Jin commented on SPARK-1112:
-
To follow up this thread, I have done some experiments
[
https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031307#comment-14031307
]
Chen Jin commented on SPARK-1112:
-
[~matei] Do you know which akka version we should use t
12 matches
Mail list logo