Michael Smith has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/20379 )

Change subject: IMPALA-12383: Fix SingleNodePlanner aggregation limits
......................................................................


Patch Set 1:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/20379/1/fe/src/main/java/org/apache/impala/planner/AggregationNode.java
File fe/src/main/java/org/apache/impala/planner/AggregationNode.java:

http://gerrit.cloudera.org:8080/#/c/20379/1/fe/src/main/java/org/apache/impala/planner/AggregationNode.java@85
PS1, Line 85: hasStreamingPreagg_
> I wonder if this new variable is logically equivalent to the following
It's not. useStreamingPreagg is only set on the pre-aggregation step.

All these flags are difficult to reason about though. I'm going to spend some 
time with them; there are 3 places we create aggregation nodes:
- SingleNodePlanner#createAggregationPlan, which can add distinct and transpose 
phases
- DistributedPlanner#createMergeAggregationFragment
- DistributedPlanner#createPhase2DistinctAggregationFragment

I think I need to understand how to generate all these and make sure we have 
test coverage. Maybe I can come up with a clearer way to describe the different 
use cases.



--
To view, visit http://gerrit.cloudera.org:8080/20379
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ic5eec1190e8e182152aa954897b79cc3f219c816
Gerrit-Change-Number: 20379
Gerrit-PatchSet: 1
Gerrit-Owner: Michael Smith <michael.sm...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
Gerrit-Reviewer: Joe McDonnell <joemcdonn...@cloudera.com>
Gerrit-Reviewer: Michael Smith <michael.sm...@cloudera.com>
Gerrit-Reviewer: Qifan Chen <qfc...@hotmail.com>
Gerrit-Reviewer: Quanlong Huang <huangquanl...@gmail.com>
Gerrit-Comment-Date: Mon, 21 Aug 2023 17:32:11 +0000
Gerrit-HasComments: Yes

Reply via email to