[
https://issues.apache.org/jira/browse/SPARK-8597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-8597:
---
Issue Type: Sub-task (was: Bug)
Parent: SPARK-5180
DataFrame partitionBy memory pressure
[
https://issues.apache.org/jira/browse/SPARK-8597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-8597:
Target Version/s: 1.5.0
Priority: Blocker (was: Critical)
DataFrame
[
https://issues.apache.org/jira/browse/SPARK-8597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matt Cheah updated SPARK-8597:
--
Summary: DataFrame partitionBy memory pressure scales extremely poorly
(was: DataFrame partitionBy
[
https://issues.apache.org/jira/browse/SPARK-8597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matt Cheah updated SPARK-8597:
--
Attachment: table.csv
DataFrame partitionBy memory pressure scales extremely poorly
[
https://issues.apache.org/jira/browse/SPARK-8597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matt Cheah updated SPARK-8597:
--
Description:
I'm running into a strange memory scaling issue when using the partitionBy
feature of