This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from ba1a7ce [SPARK-32920][FOLLOW-UP] Fix shuffleMergeFinalized directly
calling rdd.getNumPartitions as RDD is not serialized to executor
add 6e3d404 [SPARK-36217][SQL] Rename CustomShuffleReader and
OptimizeLocalShuffleReader in AQE
No new revisions were added by this update.
Summary of changes:
...ustomShuffledRDD.scala => AQEShuffledRDD.scala} | 8 +-
.../spark/scheduler/AdaptiveSchedulingSuite.scala | 8 +-
...leReaderExec.scala => AQEShuffleReadExec.scala} | 20 +-
...leReaderRule.scala => AQEShuffleReadRule.scala} | 4 +-
.../execution/adaptive/AdaptiveSparkPlanExec.scala | 12 +-
.../adaptive/CoalesceShufflePartitions.scala | 12 +-
...er.scala => OptimizeShuffleWithLocalRead.scala} | 50 ++--
.../OptimizeSkewInRebalancePartitions.scala | 4 +-
.../execution/adaptive/OptimizeSkewedJoin.scala | 10 +-
.../execution/adaptive/ShufflePartitionsUtil.scala | 2 +-
.../execution/exchange/ShuffleExchangeExec.scala | 4 +-
.../scala/org/apache/spark/sql/ExplainSuite.scala | 4 +-
.../execution/CoalesceShufflePartitionsSuite.scala | 76 +++---
.../adaptive/AdaptiveQueryExecSuite.scala | 294 ++++++++++-----------
14 files changed, 254 insertions(+), 254 deletions(-)
rename core/src/test/scala/org/apache/spark/scheduler/{CustomShuffledRDD.scala
=> AQEShuffledRDD.scala} (95%)
rename
sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/{CustomShuffleReaderExec.scala
=> AQEShuffleReadExec.scala} (93%)
rename
sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/{CustomShuffleReaderRule.scala
=> AQEShuffleReadRule.scala} (88%)
rename
sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/{OptimizeLocalShuffleReader.scala
=> OptimizeShuffleWithLocalRead.scala} (78%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
