imback82 commented on a change in pull request #28676:
URL: https://github.com/apache/spark/pull/28676#discussion_r456074465
##########
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
##########
@@ -2665,6 +2665,15 @@ object SQLConf {
.checkValue(_ > 0, "The difference must be positive.")
.createWithDefault(4)
+ val BROADCAST_HASH_JOIN_OUTPUT_PARTITIONING_EXPAND_LIMIT =
+
buildConf("spark.sql.execution.broadcastHashJoin.outputPartitioningExpandLimit")
+ .doc("The maximum number of partitionings that a HashPartitioning can be
expanded to. " +
+ "This configuration is applicable only for inner joins.")
+ .version("3.1.0")
+ .intConf
+ .checkValue(_ > 0, "The value must be positive.")
Review comment:
`1` should retain the same behavior (although it creates
`PartitioningCollection` with the original `HashPartitioning`). I added an
explicit check with `0` to disable this feature. Thanks.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
