[jira] [Updated] (SPARK-42784) Fix the problem of incomplete creation of subdirectories in push merged localDir

2023-03-14 Thread Fencheng Mei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fencheng Mei updated SPARK-42784: - Description: After we massively enabled push-based shuffle in our production environment, we

[jira] [Updated] (SPARK-42784) Fix the problem of incomplete creation of subdirectories in push merged localDir

2023-03-14 Thread Fencheng Mei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fencheng Mei updated SPARK-42784: - Description: After we massively enabled push-based shuffle in our production environment, we

[jira] [Created] (SPARK-42784) Fix the problem of incomplete creation of subdirectories in push merged localDir

2023-03-14 Thread Fencheng Mei (Jira)
Fencheng Mei created SPARK-42784: Summary: Fix the problem of incomplete creation of subdirectories in push merged localDir Key: SPARK-42784 URL: https://issues.apache.org/jira/browse/SPARK-42784

[jira] [Commented] (SPARK-40082) DAGScheduler may not schduler new stage in condition of push-based shuffle enabled

2023-03-09 Thread Fencheng Mei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698769#comment-17698769 ] Fencheng Mei commented on SPARK-40082: -- I also encountered this problem on our production

[jira] [Comment Edited] (SPARK-38066) evaluateEquality should ignore attribute without min/max ColumnStat

2022-01-29 Thread Fencheng Mei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484291#comment-17484291 ] Fencheng Mei edited comment on SPARK-38066 at 1/30/22, 2:51 AM: [Github

[jira] [Commented] (SPARK-38066) evaluateEquality should ignore attribute without min/max ColumnStat

2022-01-29 Thread Fencheng Mei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484291#comment-17484291 ] Fencheng Mei commented on SPARK-38066: -- [[SPARK-23445][FOLLOWUP] evaluateEquality should ignore

[jira] [Comment Edited] (SPARK-38066) evaluateEquality should ignore attribute without min/max ColumnStat

2022-01-29 Thread Fencheng Mei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484291#comment-17484291 ] Fencheng Mei edited comment on SPARK-38066 at 1/30/22, 2:50 AM:

[jira] [Commented] (SPARK-38066) evaluateEquality should ignore attribute without min/max ColumnStat

2022-01-29 Thread Fencheng Mei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484098#comment-17484098 ] Fencheng Mei commented on SPARK-38066: -- [~will86] please pay attention > evaluateEquality should

[jira] [Created] (SPARK-38066) evaluateEquality should ignore attribute without min/max ColumnStat

2022-01-28 Thread Fencheng Mei (Jira)
Fencheng Mei created SPARK-38066: Summary: evaluateEquality should ignore attribute without min/max ColumnStat Key: SPARK-38066 URL: https://issues.apache.org/jira/browse/SPARK-38066 Project: Spark