Tanel Kiis created SPARK-35630:
----------------------------------
Summary: ExpandExec should not introduce unnecessary exchanges
Key: SPARK-35630
URL: https://issues.apache.org/jira/browse/SPARK-35630
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.2.0
Reporter: Tanel Kiis
The Expand is commonly introduced by the RewriteDistinctAggregates optimizer
rule.
In that case there can be several attributes that are kept as they are by the
Expand.
If the child's output is partitioned by those attributes, then so will be the
output of the Expand.
In general case the Expand can output data with arbitrary partitioning, so set
it as UNKNOWN partitioning.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
