XiDuo You created SPARK-38887:
---------------------------------
Summary: Support swtich inner join side for sort merge join
Key: SPARK-38887
URL: https://issues.apache.org/jira/browse/SPARK-38887
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.4.0
Reporter: XiDuo You
For an inner join type SortMergeJoin, it always uses the left side as streamed
side and right side as buffered side.
Accoirding to the implementaion of SortMergeJoin, we expect the buffered side
to be:
* smaller than streamed side
* has less duplicate data
We do not know whether the join will be SortMergeJoin at logical phase, so it
should do this selection at physcial phase.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
