[
https://issues.apache.org/jira/browse/SPARK-42694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846293#comment-17846293
]
gaoyajun02 commented on SPARK-42694:
Have you enabled push-based shuffle?
> Data duplication and
[
https://issues.apache.org/jira/browse/SPARK-42694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824279#comment-17824279
]
liukai commented on SPARK-42694:
I also encountered this situation in spark3.1.1. Setting the parameter
[
https://issues.apache.org/jira/browse/SPARK-42694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17787074#comment-17787074
]
FengZhou commented on SPARK-42694:
--
No. Everything is OK, all the tasks are successful.
> Data
[
https://issues.apache.org/jira/browse/SPARK-42694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755329#comment-17755329
]
Shuaipeng Lee commented on SPARK-42694:
---
Are there any exeptions when the data-loss occur?
> Data
[
https://issues.apache.org/jira/browse/SPARK-42694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697682#comment-17697682
]
FengZhou commented on SPARK-42694:
--
[~yumwang]
This version has been running in production environment
[
https://issues.apache.org/jira/browse/SPARK-42694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697683#comment-17697683
]
FengZhou commented on SPARK-42694:
--
[~bjornjorgensen]
As the current upgrade would have a significant
[
https://issues.apache.org/jira/browse/SPARK-42694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697614#comment-17697614
]
Bjørn Jørgensen commented on SPARK-42694:
-
Spark 3.1 [is
[
https://issues.apache.org/jira/browse/SPARK-42694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697316#comment-17697316
]
Yuming Wang commented on SPARK-42694:
-
Could you upgrade to Spark 3.1.3 or Spark 3.3.2?
> Data
