yaooqinn commented on code in PR #55422:
URL: https://github.com/apache/spark/pull/55422#discussion_r3135556875
##########
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala:
##########
@@ -4049,6 +4049,51 @@ object SQLConf {
"The threshold of window group limit must be -1, 0 or positive
integer.")
.createWithDefault(1000)
+ val WINDOW_SEGMENT_TREE_ENABLED =
+ buildConf("spark.sql.window.segmentTree.enabled")
+ .withBindingPolicy(ConfigBindingPolicy.SESSION)
+ .doc("Use block-chunked segment tree for moving aggregate window frames
" +
+ "whose functions are all DeclarativeAggregate without
FILTER/DISTINCT.")
+ .version("4.2.0")
Review Comment:
The internal ones are just in case any regression we haven't found yet by
microbenchmark. It's unlikely for users to tune in daily workload. And even
`blockSize` can be marked as internal, however it has a bigger chance to be
tuned based on the environments
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
