[GitHub] spark pull request #21511: [SPARK-24491][Kubernetes] Configuration support f...

2018-06-27 Thread alexmilowski
Github user alexmilowski commented on a diff in the pull request: https://github.com/apache/spark/pull/21511#discussion_r198591324 --- Diff: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/BasicExecutorFeatureStep.scala --- @@ -172,7 +184,7

[GitHub] spark pull request #21511: [SPARK-24491][Kubernetes] Configuration support f...

2018-06-27 Thread alexmilowski
Github user alexmilowski commented on a diff in the pull request: https://github.com/apache/spark/pull/21511#discussion_r198591146 --- Diff: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala --- @@ -104,6 +104,20 @@ private[spark] object

[GitHub] spark issue #21511: [SPARK-24491][Kubernetes] Configuration support for requ...

2018-06-27 Thread alexmilowski
Github user alexmilowski commented on the issue: https://github.com/apache/spark/pull/21511 Hello all, I've been thinking about trying to make this more generic given I just ran into a hostPath/volume issue for executors which is similar. I took a look at SPARK-24434

[GitHub] spark pull request #21511: [SPARK-24491][Kubernetes] Configuration support f...

2018-06-07 Thread alexmilowski
GitHub user alexmilowski opened a pull request: https://github.com/apache/spark/pull/21511 [SPARK-24491][Kubernetes] Configuration support for requesting GPUs on k8s ## What changes were proposed in this pull request? Configuration support for generating the GPU requests