[
https://issues.apache.org/jira/browse/SPARK-32509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168856#comment-17168856
]
Rohit Mishra commented on SPARK-32509:
--------------------------------------
[~prakharjain09], Meanwhile you are working on the pull request, can you please
attach code sample, Environment detail or output snapshot related to the bug
for reference of the wider audience and to avoid any duplicate issue. Thanks.
> Unused DPP Filter causes issue in canonicalization and prevents reuse exchange
> ------------------------------------------------------------------------------
>
> Key: SPARK-32509
> URL: https://issues.apache.org/jira/browse/SPARK-32509
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.0.0, 3.0.1, 3.1.0
> Reporter: Prakhar Jain
> Priority: Major
>
> As part of PlanDynamicPruningFilter rule, the unused DPP Filter are simply
> replaced by `DynamicPruningExpression(TrueLiteral)` so that they can be
> avoided. But these unnecessary`DynamicPruningExpression(TrueLiteral)`
> partition filter inside the FileSourceScanExec affects the canonicalization
> of the node and so in many cases, this can prevent ReuseExchange from
> happening.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
