Cheng Su created SPARK-36652:
--------------------------------
Summary: AQE dynamic join selection should not apply to non-equi
join
Key: SPARK-36652
URL: https://issues.apache.org/jira/browse/SPARK-36652
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.2.0, 3.3.0
Reporter: Cheng Su
Currently `DynamicJoinSelection` has two features: 1.demote broadcast hash
join, and 2.promote shuffled hash join. Both are achieved by adding join hint
in query plan, and only works for equi join. However the rule is matching with
`Join` operator now -
[https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/DynamicJoinSelection.scala#L71,]
so it would add hint for non-equi join by mistake.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
