hhr293 commented on code in PR #58424:
URL: https://github.com/apache/spark/pull/58424#discussion_r3948226338
##########
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala:
##########
@@ -669,6 +669,18 @@ object SQLConf {
"for using switch statements in InSet must be non-negative and less
than or equal to 600")
.createWithDefault(400)
+ val REWRITE_SELF_JOIN_INEQUALITY_TO_AGGREGATE_ENABLED =
+
buildConf("spark.sql.optimizer.rewriteSelfJoinInequalityToAggregate.enabled")
+ .internal()
+ .doc("When true, rewrites a supported existence-only inequality
self-join inside an " +
Review Comment:
Agreed. I'll make the supported sources explicit in both the SQLConf
documentation and the PR description.
For the DEBUG log, I'll try to find a lightweight way to expose the
rejection reason without adding unnecessary complexity in the fixed-point
batches.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
