[jira] [Commented] (SPARK-24961) sort operation causes out of memory

[ https://issues.apache.org/jira/browse/SPARK-24961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868522#comment-16868522 ] Juha Iso-Sipilä commented on SPARK-24961: - I am using Spark 2.4.3 (pyspark) and

[jira] [Commented] (SPARK-24961) sort operation causes out of memory

[ https://issues.apache.org/jira/browse/SPARK-24961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16758557#comment-16758557 ] Mono Shiro commented on SPARK-24961: Spark Version 2.3.2.  I have a very similar iss

[jira] [Commented] (SPARK-24961) sort operation causes out of memory

[ https://issues.apache.org/jira/browse/SPARK-24961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587850#comment-16587850 ] Markus Breuer commented on SPARK-24961: --- Some notes to your last comment: Reducin

[jira] [Commented] (SPARK-24961) sort operation causes out of memory

[ https://issues.apache.org/jira/browse/SPARK-24961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585258#comment-16585258 ] Markus Breuer commented on SPARK-24961: --- I retested the above code and had to corr

[jira] [Commented] (SPARK-24961) sort operation causes out of memory

[ https://issues.apache.org/jira/browse/SPARK-24961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16584961#comment-16584961 ] Liang-Chi Hsieh commented on SPARK-24961: - When you run global sort, Spark will

[jira] [Commented] (SPARK-24961) sort operation causes out of memory

[ https://issues.apache.org/jira/browse/SPARK-24961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16584955#comment-16584955 ] Markus Breuer commented on SPARK-24961: --- I started without specifying memory level

[jira] [Commented] (SPARK-24961) sort operation causes out of memory

[ https://issues.apache.org/jira/browse/SPARK-24961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16584944#comment-16584944 ] Liang-Chi Hsieh commented on SPARK-24961: - I think it seems not common or practi

[jira] [Commented] (SPARK-24961) sort operation causes out of memory

[ https://issues.apache.org/jira/browse/SPARK-24961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16584943#comment-16584943 ] Liang-Chi Hsieh commented on SPARK-24961: - I saw you described {{Spark 2.3.1 in

[jira] [Commented] (SPARK-24961) sort operation causes out of memory

[ https://issues.apache.org/jira/browse/SPARK-24961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16584929#comment-16584929 ] Markus Breuer commented on SPARK-24961: --- There was no feedback from stackoverflow

[jira] [Commented] (SPARK-24961) sort operation causes out of memory

[ https://issues.apache.org/jira/browse/SPARK-24961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16562359#comment-16562359 ] Markus Breuer commented on SPARK-24961: --- I think it is an issue and I explained wh

[jira] [Commented] (SPARK-24961) sort operation causes out of memory

[ https://issues.apache.org/jira/browse/SPARK-24961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16561615#comment-16561615 ] Hyukjin Kwon commented on SPARK-24961: -- Please avoid setting a target version which