Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/19476#discussion_r145011775
--- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala
---
@@ -684,7 +713,7 @@ private[spark] class BlockManager(
// take a significant amount of time. To get rid of these stale
entries
// we refresh the block locations after a certain number of
fetch failures
if (runningFailureCount >= maxFailuresBeforeLocationRefresh) {
- locationIterator = getLocations(blockId).iterator
+ locationIterator =
sortLocations(master.getLocationsAndStatus(blockId)._1).iterator
--- End diff --
Agreed, will change it.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
