[
https://issues.apache.org/jira/browse/SPARK-45924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Asif updated SPARK-45924:
-------------------------
Description:
while writing bug test for
[SPARK-45866|https://issues.apache.org/jira/projects/SPARK/issues/SPARK-45866],
found that canonicalization of SubqueryAdaptiveBroadcastExec is broken in the
sense that buildPlan : LogicalPlan is not canonicalized which causes batchscans
to differ when reuse of exchange check happens in AQE.
Moreover the equivalence of SubqueryAdaptiveBroadcastExec and
SubqueryBroadcastExec is not there which also aggravates the re-use of
exchange in aqe broken.
was:
while writing bug test for [SPARK-45866|http://example.com], found that
canonicalization of SubqueryAdaptiveBroadcastExec is broken in the sense that
buildPlan : LogicalPlan is not canonicalized which causes batchscans to differ
when reuse of exchange check happens in AQE.
Moreover the equivalence of SubqueryAdaptiveBroadcastExec and
SubqueryBroadcastExec is not there which also aggravates the re-use of
exchange in aqe broken.
> Canonicalization of SubqueryAdaptiveBroadcastExec is broken and is not
> equivalent with SubqueryBroadcastExec
> ------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-45924
> URL: https://issues.apache.org/jira/browse/SPARK-45924
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.5.1
> Reporter: Asif
> Priority: Major
>
> while writing bug test for
> [SPARK-45866|https://issues.apache.org/jira/projects/SPARK/issues/SPARK-45866],
> found that canonicalization of SubqueryAdaptiveBroadcastExec is broken in
> the sense that buildPlan : LogicalPlan is not canonicalized which causes
> batchscans to differ when reuse of exchange check happens in AQE.
> Moreover the equivalence of SubqueryAdaptiveBroadcastExec and
> SubqueryBroadcastExec is not there which also aggravates the re-use of
> exchange in aqe broken.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
