[jira] [Updated] (SPARK-33022) partition length is wrong after merge partition segments in BypassMergeSortShuffleWriter

2020-09-29 Thread duanmeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] duanmeng updated SPARK-33022: - Description: The segment file may be empty even after writer committing caused by disk/kernel in heavy

[jira] [Updated] (SPARK-33022) partition length is wrong after merge partition segments in BypassMergeSortShuffleWriter

2020-09-29 Thread duanmeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] duanmeng updated SPARK-33022: - Description: A data file might be empty even after  DiskBlockObjectWriter committing it in BypassMergeS

[jira] [Updated] (SPARK-33022) partition length is wrong after merge partition segments in BypassMergeSortShuffleWriter

2020-09-29 Thread duanmeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] duanmeng updated SPARK-33022: - Description: A data file might be empty even after  DiskBlockObjectWriter committing it in BypassMergeS

[jira] [Updated] (SPARK-33022) partition length is wrong after merge partition segments in BypassMergeSortShuffleWriter

2020-09-29 Thread duanmeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] duanmeng updated SPARK-33022: - Description: A data file might be empty even after  DiskBlockObjectWriter committing it in BypassMergeS

[jira] [Updated] (SPARK-33022) partition length is wrong after merge partition segments in BypassMergeSortShuffleWriter

2020-09-29 Thread duanmeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] duanmeng updated SPARK-33022: - Description: A data file might be empty even after  DiskBlockObjectWriter committing it in BypassMergeS

[jira] [Created] (SPARK-33022) partition length is wrong after merge partition segments in BypassMergeSortShuffleWriter

2020-09-29 Thread duanmeng (Jira)
duanmeng created SPARK-33022: Summary: partition length is wrong after merge partition segments in BypassMergeSortShuffleWriter Key: SPARK-33022 URL: https://issues.apache.org/jira/browse/SPARK-33022 Proj