Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190769478
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsPollingEventSource.scala
---
@@ -0,0 +1,58
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190762965
--- Diff:
resource-managers/kubernetes/core/src/test/scala/org/apache/spark/scheduler/cluster/k8s/DeterministicExecutorPodsEventQueue.scala
---
@@ -0,0
Github user erikerlandson commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190755750
--- Diff:
resource-managers/kubernetes/core/src/test/scala/org/apache/spark/scheduler/cluster/k8s/DeterministicExecutorPodsEventQueue.scala
---
@@
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190398282
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsEventHandler.scala
---
@@ -0,0 +1,229 @@
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190389782
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsEventHandler.scala
---
@@ -0,0 +1,229 @@
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190386369
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsEventHandler.scala
---
@@ -0,0 +1,229 @@
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190385827
--- Diff: pom.xml ---
@@ -760,6 +760,12 @@
1.10.19
test
+
--- End diff --
We always add to the
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190372105
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsEventHandler.scala
---
@@ -0,0 +1,229 @@
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190367677
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsEventHandler.scala
---
@@ -0,0 +1,229 @@
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190367420
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsEventHandler.scala
---
@@ -0,0 +1,229 @@
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190366267
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsWatchEventSource.scala
---
@@ -0,0 +1,63 @@
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190365981
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsEventHandler.scala
---
@@ -0,0 +1,229 @@
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190365332
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsEventHandler.scala
---
@@ -0,0 +1,229 @@
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190356134
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsEventHandler.scala
---
@@ -0,0 +1,229 @@
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190356590
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsPollingEventSource.scala
---
@@ -0,0
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190354568
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsEventHandler.scala
---
@@ -0,0 +1,229 @@
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190356761
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsPollingEventSource.scala
---
@@ -0,0
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190350967
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsEventHandler.scala
---
@@ -0,0 +1,229 @@
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190350563
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsEventHandler.scala
---
@@ -0,0 +1,229 @@
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190358300
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsWatchEventSource.scala
---
@@ -0,0 +1,63
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190358018
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsWatchEventSource.scala
---
@@ -0,0 +1,63
Github user liyinan926 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r190349318
--- Diff: pom.xml ---
@@ -760,6 +760,12 @@
1.10.19
test
+
--- End diff --
Why adding this to
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r189739169
--- Diff: pom.xml ---
@@ -150,6 +150,7 @@
4.5.4
4.4.8
+3.0.1
--- End diff --
Noted, will remove in the next
Github user erikerlandson commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r189735073
--- Diff: pom.xml ---
@@ -150,6 +150,7 @@
4.5.4
4.4.8
+3.0.1
--- End diff --
My take is that the
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r189642632
--- Diff: pom.xml ---
@@ -150,6 +150,7 @@
4.5.4
4.4.8
+3.0.1
--- End diff --
These are data structures
Github user erikerlandson commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r189435162
--- Diff: pom.xml ---
@@ -150,6 +150,7 @@
4.5.4
4.4.8
+3.0.1
--- End diff --
it looks like this dep
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r189401135
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsPollingEventSource.scala
---
@@ -0,0 +1,58
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r189400912
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsPollingEventSource.scala
---
@@ -0,0 +1,58
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r189400286
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsEventHandler.scala
---
@@ -0,0 +1,212 @@
Github user mccheah commented on a diff in the pull request:
https://github.com/apache/spark/pull/21366#discussion_r189399432
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsEventHandler.scala
---
@@ -0,0 +1,212 @@
GitHub user mccheah opened a pull request:
https://github.com/apache/spark/pull/21366
[SPARK-24248][K8S][WIP] Use the Kubernetes API to populate an event queue
for scheduling
## What changes were proposed in this pull request?
Previously, the scheduler backend was
31 matches
Mail list logo
