[
https://issues.apache.org/jira/browse/SPARK-33964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tanel Kiis updated SPARK-33964:
-------------------------------
Description:
In several TPCDS queries the CombineUnions rule does not manage to combine
unions, because they have noop Projects between them.
The Projects will be removed by RemoveNoopOperators, but by then
ReplaceDistinctWithAggregate has been applied and there are aggregates between
the unions.
> Combine distinct unions in more cases
> -------------------------------------
>
> Key: SPARK-33964
> URL: https://issues.apache.org/jira/browse/SPARK-33964
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.2.0
> Reporter: Tanel Kiis
> Priority: Major
>
> In several TPCDS queries the CombineUnions rule does not manage to combine
> unions, because they have noop Projects between them.
> The Projects will be removed by RemoveNoopOperators, but by then
> ReplaceDistinctWithAggregate has been applied and there are aggregates
> between the unions.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
