[jira] [Assigned] (SPARK-34637) Support DPP in AQE when the boradcast exchange can be reused
[ https://issues.apache.org/jira/browse/SPARK-34637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34637: --- Assignee: Ke Jia > Support DPP in AQE when the boradcast exchange can be reused > > > Key: SPARK-34637 > URL: https://issues.apache.org/jira/browse/SPARK-34637 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 3.2.0 >Reporter: Ke Jia >Assignee: Ke Jia >Priority: Major > > We have supported DPP in AQE when the join is Broadcast hash join before > applying the AQE rules in SPARK-34168, which has some limitations. It only > apply DPP when the small table side executed firstly and then the big table > side can reuse the broadcast exchange in small table side. This Jira is to > address the above limitations and can apply the DPP when the broadcast > exchange can be reused. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-34637) Support DPP in AQE when the boradcast exchange can be reused
[ https://issues.apache.org/jira/browse/SPARK-34637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34637: Assignee: (was: Apache Spark) > Support DPP in AQE when the boradcast exchange can be reused > > > Key: SPARK-34637 > URL: https://issues.apache.org/jira/browse/SPARK-34637 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.1.1 >Reporter: Ke Jia >Priority: Major > > We have supported DPP in AQE when the join is Broadcast hash join before > applying the AQE rules in SPARK-34168, which has some limitations. It only > apply DPP when the small table side executed firstly and then the big table > side can reuse the broadcast exchange in small table side. This Jira is to > address the above limitations and can apply the DPP when the broadcast > exchange can be reused. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-34637) Support DPP in AQE when the boradcast exchange can be reused
[ https://issues.apache.org/jira/browse/SPARK-34637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34637: Assignee: Apache Spark > Support DPP in AQE when the boradcast exchange can be reused > > > Key: SPARK-34637 > URL: https://issues.apache.org/jira/browse/SPARK-34637 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.1.1 >Reporter: Ke Jia >Assignee: Apache Spark >Priority: Major > > We have supported DPP in AQE when the join is Broadcast hash join before > applying the AQE rules in SPARK-34168, which has some limitations. It only > apply DPP when the small table side executed firstly and then the big table > side can reuse the broadcast exchange in small table side. This Jira is to > address the above limitations and can apply the DPP when the broadcast > exchange can be reused. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
