[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r468975271 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala ## @@ -503,6 +450,88 @@ class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r468974739 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala ## @@ -503,6 +450,88 @@ class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r468973773 ## File path: core/src/test/scala/org/apache/spark/deploy/DecommissionWorkerSuite.scala ## @@ -242,8 +242,10 @@ class DecommissionWorkerSuite

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r468905696 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala ## @@ -503,6 +450,88 @@ class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r468902557 ## File path: core/src/test/scala/org/apache/spark/deploy/DecommissionWorkerSuite.scala ## @@ -242,8 +242,10 @@ class DecommissionWorkerSuite

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r468821063 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala ## @@ -503,6 +504,102 @@ class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r468819586 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala ## @@ -503,6 +504,102 @@ class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r468763396 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala ## @@ -503,6 +504,102 @@ class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r468224221 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala ## @@ -503,6 +504,102 @@ class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r468207413 ## File path: core/src/test/scala/org/apache/spark/scheduler/WorkerDecommissionSuite.scala ## @@ -76,7 +76,9 @@ class WorkerDecommissionSuite extends

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r468206956 ## File path: core/src/main/scala/org/apache/spark/scheduler/dynalloc/ExecutorMonitor.scala ## @@ -326,18 +352,33 @@ private[spark] class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r468206734 ## File path: core/src/main/scala/org/apache/spark/scheduler/dynalloc/ExecutorMonitor.scala ## @@ -298,6 +323,7 @@ private[spark] class ExecutorMonitor(

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r468205961 ## File path: core/src/main/scala/org/apache/spark/scheduler/dynalloc/ExecutorMonitor.scala ## @@ -114,7 +114,8 @@ private[spark] class ExecutorMonitor(

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r468204518 ## File path: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ## @@ -565,8 +573,14 @@ private[spark] class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r468095732 ## File path: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ## @@ -565,8 +573,14 @@ private[spark] class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r468094188 ## File path: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ## @@ -565,8 +573,14 @@ private[spark] class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r468076602 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala ## @@ -503,6 +504,102 @@ class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r467491962 ## File path: streaming/src/test/scala/org/apache/spark/streaming/scheduler/ExecutorAllocationManagerSuite.scala ## @@ -83,12 +96,26 @@ class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r467491912 ## File path: core/src/test/scala/org/apache/spark/scheduler/WorkerDecommissionSuite.scala ## @@ -76,7 +76,9 @@ class WorkerDecommissionSuite extends

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r467491854 ## File path: core/src/main/scala/org/apache/spark/scheduler/dynalloc/ExecutorMonitor.scala ## @@ -326,18 +352,33 @@ private[spark] class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r467491346 ## File path: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ## @@ -204,7 +205,12 @@ private[spark] class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r467491189 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala ## @@ -503,6 +504,102 @@ class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466792718 ## File path: core/src/main/scala/org/apache/spark/ExecutorAllocationClient.scala ## @@ -81,6 +82,45 @@ private[spark] trait ExecutorAllocationClient {

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466777024 ## File path: core/src/main/scala/org/apache/spark/ExecutorAllocationClient.scala ## @@ -81,6 +82,43 @@ private[spark] trait ExecutorAllocationClient {

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466639706 ## File path: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ExecutorAllocationManager.scala ## @@ -133,7 +135,12 @@ private[streaming]

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466639023 ## File path: core/src/test/scala/org/apache/spark/ExecutorAllocationManagerSuite.scala ## @@ -1270,6 +1271,68 @@ class ExecutorAllocationManagerSuite

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466639242 ## File path: core/src/test/scala/org/apache/spark/storage/BlockManagerDecommissionIntegrationSuite.scala ## @@ -276,6 +276,8 @@ class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466638541 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerMaster.scala ## @@ -43,9 +43,12 @@ class BlockManagerMaster( logInfo("Removed

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466638195 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerDecommissioner.scala ## @@ -314,9 +314,13 @@ private[storage] class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466637640 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerDecommissioner.scala ## @@ -314,9 +314,13 @@ private[storage] class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466636565 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManager.scala ## @@ -1822,7 +1822,7 @@ private[spark] class BlockManager( } } -

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466636251 ## File path: core/src/main/scala/org/apache/spark/scheduler/dynalloc/ExecutorMonitor.scala ## @@ -326,18 +352,33 @@ private[spark] class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466634142 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala ## @@ -503,6 +505,100 @@ class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466633630 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala ## @@ -503,6 +505,100 @@ class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466630246 ## File path: core/src/main/scala/org/apache/spark/ExecutorAllocationClient.scala ## @@ -81,6 +82,43 @@ private[spark] trait ExecutorAllocationClient {

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466629375 ## File path: core/src/main/scala/org/apache/spark/ExecutorAllocationClient.scala ## @@ -81,6 +82,43 @@ private[spark] trait ExecutorAllocationClient {

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466628639 ## File path: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ## @@ -204,7 +205,12 @@ private[spark] class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466628938 ## File path: core/src/main/scala/org/apache/spark/ExecutorAllocationClient.scala ## @@ -81,6 +82,43 @@ private[spark] trait ExecutorAllocationClient {

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466627169 ## File path: core/src/main/scala/org/apache/spark/scheduler/dynalloc/ExecutorMonitor.scala ## @@ -114,7 +114,8 @@ private[spark] class ExecutorMonitor(

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466626454 ## File path: core/src/main/scala/org/apache/spark/scheduler/dynalloc/ExecutorMonitor.scala ## @@ -149,6 +151,19 @@ private[spark] class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466626059 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala ## @@ -274,7 +275,8 @@ class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466624663 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala ## @@ -193,7 +193,8 @@ class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466623768 ## File path: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ## @@ -565,8 +573,14 @@ private[spark] class

[GitHub] [spark] holdenk commented on a change in pull request #29367: [SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

holdenk commented on a change in pull request #29367: URL: https://github.com/apache/spark/pull/29367#discussion_r466622049 ## File path: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ## @@ -204,7 +205,12 @@ private[spark] class