[jira] [Commented] (SPARK-671) Spark runs out of memory on fork/exec (affects both pipes and python)

[ https://issues.apache.org/jira/browse/SPARK-671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985114#comment-14985114 ] hotdog commented on SPARK-671: -- is it still a problem? > Spark runs out of memory on fork/exec (affects both

[jira] [Commented] (SPARK-671) Spark runs out of memory on fork/exec (affects both pipes and python)

[ https://issues.apache.org/jira/browse/SPARK-671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985124#comment-14985124 ] hotdog commented on SPARK-671: -- is it still a problem in latest version? I 'm using pipe() operation, and

[jira] [Issue Comment Deleted] (SPARK-671) Spark runs out of memory on fork/exec (affects both pipes and python)

[ https://issues.apache.org/jira/browse/SPARK-671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hotdog updated SPARK-671: - Comment: was deleted (was: is it still a problem? ) > Spark runs out of memory on fork/exec (affects both pipes

[jira] [Commented] (SPARK-6190) create LargeByteBuffer abstraction for eliminating 2GB limit on blocks

[ https://issues.apache.org/jira/browse/SPARK-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979886#comment-14979886 ] hotdog commented on SPARK-6190: --- is there any progress? > create LargeByteBuffer abstraction for

[jira] [Updated] (SPARK-11101) pipe() operation OOM

[ https://issues.apache.org/jira/browse/SPARK-11101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hotdog updated SPARK-11101: --- Description: when using pipe() operation with large data(10TB), the pipe() operation always OOM. I use