[GitHub] [spark] Victsm commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external s

2020-11-17 Thread GitBox
Victsm commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r525835969 ## File path: core/src/main/scala/org/apache/spark/scheduler/SchedulerBackend.scala ## @@ -92,4 +93,16 @@ private[spark] trait SchedulerBackend { */

[GitHub] [spark] Victsm commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external s

2020-11-17 Thread GitBox
Victsm commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r525832654 ## File path: core/src/main/scala/org/apache/spark/util/Utils.scala ## @@ -2541,6 +2541,16 @@ private[spark] object Utils extends Logging { master ==

[GitHub] [spark] Victsm commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external s

2020-11-16 Thread GitBox
Victsm commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r524541577 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala ## @@ -657,6 +688,43 @@ class BlockManagerMasterEndpoint(

[GitHub] [spark] Victsm commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external s

2020-11-16 Thread GitBox
Victsm commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r524527610 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala ## @@ -657,6 +688,43 @@ class BlockManagerMasterEndpoint(

[GitHub] [spark] Victsm commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external s

2020-11-16 Thread GitBox
Victsm commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r524527610 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala ## @@ -657,6 +688,43 @@ class BlockManagerMasterEndpoint(

[GitHub] [spark] Victsm commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external s

2020-11-14 Thread GitBox
Victsm commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r523714996 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala ## @@ -657,6 +688,38 @@ class BlockManagerMasterEndpoint(

[GitHub] [spark] Victsm commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external s

2020-11-14 Thread GitBox
Victsm commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r523713075 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1252,6 +1254,28 @@ private[spark] class DAGScheduler(

[GitHub] [spark] Victsm commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external s

2020-11-14 Thread GitBox
Victsm commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r523712631 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala ## @@ -360,6 +371,17 @@ class BlockManagerMasterEndpoint(

[GitHub] [spark] Victsm commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external s

2020-11-14 Thread GitBox
Victsm commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r523711623 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1252,6 +1254,32 @@ private[spark] class DAGScheduler(

[GitHub] [spark] Victsm commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external s

2020-11-14 Thread GitBox
Victsm commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r523711581 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1252,6 +1254,32 @@ private[spark] class DAGScheduler(

[GitHub] [spark] Victsm commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external s

2020-11-14 Thread GitBox
Victsm commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r523711229 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ## @@ -1938,4 +1938,51 @@ package object config {

[GitHub] [spark] Victsm commented on a change in pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external s

2020-11-14 Thread GitBox
Victsm commented on a change in pull request #30164: URL: https://github.com/apache/spark/pull/30164#discussion_r523710562 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala ## @@ -657,6 +681,13 @@ class BlockManagerMasterEndpoint(