Adam Binford created SEDONA-56:
----------------------------------
Summary: Broadcast join doesn't work with AQE enabled
Key: SEDONA-56
URL: https://issues.apache.org/jira/browse/SEDONA-56
Project: Apache Sedona
Issue Type: Bug
Affects Versions: 1.0.1
Reporter: Adam Binford
If you have AQE enabled (spark.sql.adaptive.enabled=true), broadcast joins fail
with a MatchError due to:
[https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/AdaptiveSparkPlanExec.scala#L533-L560.]
This is because SpatialJoinExec extends `Exchange`, but doesn't implement
BroadcastExchangeLike. It needs to be updated to either not extend Exchange, or
make direct use of `BroadcastExchangeExec` instead of doing the broadcast
itself.
Current workaround is disable AQE, which is the current default but will be
enabled by default starting in Spark 3.2.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
