Ayushi Agarwal created SPARK-40177:
--------------------------------------
Summary: Simplify join condition of form (a==b) ||
(a==null&&b==null) to a<=>b
Key: SPARK-40177
URL: https://issues.apache.org/jira/browse/SPARK-40177
Project: Spark
Issue Type: Task
Components: SQL
Affects Versions: 3.3.0, 3.2.0
Reporter: Ayushi Agarwal
Fix For: 3.3.1
If the join condition is like key1==key2 || (key1==null && key2==null), join is
executed as Broadcast Nested Loop Join as this condition doesn't satisfy equi
join condition. BNLJ takes more time as compared to Sort merge or broadcast
join. This condition can be converted to key1<=>key2 to make the join execute
as Broadcast or sort merge join.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
