peter-toth commented on code in PR #55628:
URL: https://github.com/apache/spark/pull/55628#discussion_r3173332086
##########
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala:
##########
@@ -6608,6 +6608,21 @@ object SQLConf {
.booleanConf
.createWithDefault(false)
+ val MERGE_SUBPLANS_FILTER_PROPAGATION_THROUGH_JOIN_ENABLED =
+ buildConf(
+
"spark.sql.optimizer.mergeSubplans.filterPropagation.filterPropagationThroughJoin.enabled")
+ .doc("When set to true, filter attributes can propagate through Join
nodes during subplan " +
+ "merging, allowing subplans that differ only in their filter
conditions and share a " +
+ "common join to be merged into a single scan. A filter attribute is
only propagated " +
+ "through a join when it originates from the non-nullable (preserved)
side: the left side " +
+ "of LeftOuter/LeftSemi/LeftAnti, the right side of RightOuter, or
either side of " +
Review Comment:
Fixed in
https://github.com/apache/spark/pull/55628/commits/4d87515c6de9583e4f6999094cb91a6d4dd70312.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
