[ https://issues.apache.org/jira/browse/SPARK-45607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wan Kun updated SPARK-45607: ---------------------------- Summary: Collapse repartitions with project (was: Collapse repartition with project) > Collapse repartitions with project > ---------------------------------- > > Key: SPARK-45607 > URL: https://issues.apache.org/jira/browse/SPARK-45607 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 4.0.0 > Reporter: Wan Kun > Priority: Major > > We can collapse two repartition operators with a project between them. > For example: > df.repartition($"a").select($"a", $"b", $"a" + $"b").repartition($"b") > is same to > df.select($"a", $"b", $"a" + $"b").repartition($"b") -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org