Github user dhruve closed the pull request at:
https://github.com/apache/spark/pull/14926
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user dhruve commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r79198768
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,70 @@ private[spark] class ExecutorAllocationManager(
Github user dhruve commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r79198414
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
---
@@ -564,6 +564,8 @@ class CoarseGrainedSchedulerBack
Github user dhruve commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r79217027
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,70 @@ private[spark] class ExecutorAllocationManager(
Github user dhruve commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r79196391
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
---
@@ -583,7 +585,17 @@ class CoarseGrainedSchedulerBac
Github user dhruve commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r79199040
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,70 @@ private[spark] class ExecutorAllocationManager(
Github user dhruve commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r79196128
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/scheduler/JobScheduler.scala
---
@@ -83,8 +84,14 @@ class JobScheduler(val ssc: StreamingContex
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r79036171
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,70 @@ private[spark] class ExecutorAllocationManager(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r79038316
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
---
@@ -583,7 +585,17 @@ class CoarseGrainedSchedulerBac
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r79037842
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
---
@@ -564,6 +564,8 @@ class CoarseGrainedSchedulerBack
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r79035363
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,70 @@ private[spark] class ExecutorAllocationManager(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r79035412
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,70 @@ private[spark] class ExecutorAllocationManager(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r79037417
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -1575,13 +1581,14 @@ class SparkContext(config: SparkConf) extends
Logging with Execu
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r79036915
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -409,26 +474,7 @@ private[spark] class ExecutorAllocationManager(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r79038521
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/scheduler/JobScheduler.scala
---
@@ -83,8 +84,14 @@ class JobScheduler(val ssc: StreamingContex
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r79036795
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,70 @@ private[spark] class ExecutorAllocationManager(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r79035297
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,70 @@ private[spark] class ExecutorAllocationManager(
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r78772541
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -2535,7 +2539,7 @@ object SparkContext extends Logging {
private def g
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r78772038
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -36,18 +36,15 @@ import com.google.common.collect.MapMaker
import org.apache.c
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r78771555
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -29,6 +29,7 @@ import org.apache.spark.internal.Logging
import o
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r78106170
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,36 @@ private[spark] class ExecutorAllocationManager(
Github user dhruve commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r78092320
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,36 @@ private[spark] class ExecutorAllocationManager(
Github user dhruve commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r77724521
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,36 @@ private[spark] class ExecutorAllocationManager(
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r77723977
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,36 @@ private[spark] class ExecutorAllocationManager(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r77720376
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,36 @@ private[spark] class ExecutorAllocationManager(
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r77719621
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,36 @@ private[spark] class ExecutorAllocationManager(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r77684425
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,36 @@ private[spark] class ExecutorAllocationManager(
Github user dhruve commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r77684087
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,36 @@ private[spark] class ExecutorAllocationManager(
Github user dhruve commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r77683485
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,36 @@ private[spark] class ExecutorAllocationManager(
Github user dhruve commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r77680444
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,36 @@ private[spark] class ExecutorAllocationManager(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r77426133
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,36 @@ private[spark] class ExecutorAllocationManager(
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r77309831
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,36 @@ private[spark] class ExecutorAllocationManager(
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r77309507
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,36 @@ private[spark] class ExecutorAllocationManager(
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r77309440
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -392,10 +397,36 @@ private[spark] class ExecutorAllocationManager(
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r77309343
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -279,14 +280,18 @@ private[spark] class ExecutorAllocationManager(
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/14926#discussion_r77309320
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -279,14 +280,18 @@ private[spark] class ExecutorAllocationManager(
GitHub user dhruve opened a pull request:
https://github.com/apache/spark/pull/14926
[SPARK-17365][Core] Remove/Kill multiple executors together to reduceâ¦
## What changes were proposed in this pull request?
We are killing multiple executors together instead of iterating over
37 matches
Mail list logo
