[
https://issues.apache.org/jira/browse/SPARK-38506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17541486#comment-17541486
]
Yuming Wang commented on SPARK-38506:
-------------------------------------
Benchmark result:
|SQL|Before(ms)|With Partial Aggregation Optimization(ms)|
|v1.4 q4|72478|61261|
|v1.4 q5|23235|20971|
|v1.4 q10|13406|8422|
|v1.4 q11|37975|24236|
|v1.4 q14a|154484|52502|
|v1.4 q14b|128712|57363|
|v1.4 q23a|153233|58932|
|v1.4 q23b|159162|78401|
|v1.4 q24a|392441|84826|
|v1.4 q24b|408129|76384|
|v1.4 q31|14696|13766|
|v1.4 q35|29005|17662|
|v1.4 q37|20076|9218|
|v1.4 q47|36560|31299|
|v1.4 q54|12283|11306|
|v1.4 q57|38530|35303|
|v1.4 q69|15839|11968|
|v1.4 q82|24498|13451|
|v1.4 q95|69196|42653|
|v2.7 q6|9129|10527|
|v2.7 q10a|11778|9909|
|v2.7 q11|40113|29130|
|v2.7 q14|159807|38052|
|v2.7 q14a|238149|128097|
|v2.7 q22a|9344|5269|
|v2.7 q35|36910|14705|
|v2.7 q35a|32793|13303|
|v2.7 q47|49689|27308|
|v2.7 q57|26016|28775|
|v2.7 q74|42607|19340|
|modifiedQueries q10|11675|8628|
|modifiedQueries q98|6877|5219|
> Push partial aggregation through join
> -------------------------------------
>
> Key: SPARK-38506
> URL: https://issues.apache.org/jira/browse/SPARK-38506
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.3.0
> Reporter: Yuming Wang
> Priority: Major
>
> Please see
> https://docs.teradata.com/r/Teradata-VantageTM-SQL-Request-and-Transaction-Processing/March-2019/Join-Planning-and-Optimization/Partial-GROUP-BY-Block-Optimization
> for more details.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
