This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git.
from f3c2583 [SPARK-33185][YARN][FOLLOW-ON] Leverage RM's RPC API instead of REST to fetch driver log links in yarn.Client add c699435 [SPARK-33545][CORE] Support Fallback Storage during Worker decommission No new revisions were added by this update. Summary of changes: core/pom.xml | 41 ++++ .../main/scala/org/apache/spark/SparkContext.scala | 1 + .../org/apache/spark/internal/config/package.scala | 10 + .../spark/shuffle/IndexShuffleBlockResolver.scala | 2 +- .../org/apache/spark/storage/BlockManager.scala | 18 +- .../spark/storage/BlockManagerDecommissioner.scala | 3 + .../org/apache/spark/storage/FallbackStorage.scala | 174 +++++++++++++ .../storage/ShuffleBlockFetcherIterator.scala | 3 +- .../spark/storage/FallbackStorageSuite.scala | 269 +++++++++++++++++++++ 9 files changed, 517 insertions(+), 4 deletions(-) create mode 100644 core/src/main/scala/org/apache/spark/storage/FallbackStorage.scala create mode 100644 core/src/test/scala/org/apache/spark/storage/FallbackStorageSuite.scala --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org