This is an automated email from the ASF dual-hosted git repository. vanzin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git.
from 1a3858a [SPARK-26985][CORE] Fix "access only some column of the all of columns " for big endian architecture BUG add b71c130 [SPARK-27622][CORE] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host No new revisions were added by this update. Summary of changes: .../spark/network/shuffle/ExecutorDiskUtils.java | 66 +++++++++++ .../shuffle/ExternalShuffleBlockResolver.java | 45 +------- .../shuffle/ExternalShuffleBlockResolverSuite.java | 2 +- .../network/shuffle/TestShuffleDataContext.java | 9 +- .../org/apache/spark/storage/BlockManager.scala | 121 ++++++++++++++++---- .../apache/spark/storage/BlockManagerMaster.scala | 13 ++- .../spark/storage/BlockManagerMasterEndpoint.scala | 32 ++++-- .../spark/storage/BlockManagerMessages.scala | 17 ++- .../apache/spark/storage/DiskBlockManager.scala | 5 +- .../spark/storage/BlockManagerInfoSuite.scala | 1 + .../apache/spark/storage/BlockManagerSuite.scala | 124 +++++++++++++++++++-- 11 files changed, 342 insertions(+), 93 deletions(-) create mode 100644 common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/ExecutorDiskUtils.java --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org