[GitHub] spark issue #23013: [SPARK-25023] More detailed security guidance for K8S

2018-11-19 Thread mccheah
Github user mccheah commented on the issue: https://github.com/apache/spark/pull/23013 The SASL mechanisms still work, though it's more similar to something like standalone mode than having the robustness of YARN. We could generate the SASL secrets and put them in K8s secrets as a k8s

[GitHub] spark issue #23013: [SPARK-25023] More detailed security guidance for K8S

2018-11-19 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/23013 sorry for my delay as I was on vacation. I would like to clarify if k8s support spark.authenticate and if so how does it do it?Without that, Spark is not secure with k8s unless you are securi

[GitHub] spark issue #23013: [SPARK-25023] More detailed security guidance for K8S

2018-11-16 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/23013 Merged to master/2.4 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h

[GitHub] spark issue #23013: [SPARK-25023] More detailed security guidance for K8S

2018-11-16 Thread nrchakradhar
Github user nrchakradhar commented on the issue: https://github.com/apache/spark/pull/23013 The description is very useful and concise. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additiona

[GitHub] spark issue #23013: [SPARK-25023] More detailed security guidance for K8S

2018-11-15 Thread rvesse
Github user rvesse commented on the issue: https://github.com/apache/spark/pull/23013 @srowen I'm happy with it --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: revi

[GitHub] spark issue #23013: [SPARK-25023] More detailed security guidance for K8S

2018-11-15 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/23013 @tgravescs @mccheah @rvesse is this pretty much OK with all of you? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache

[GitHub] spark issue #23013: [SPARK-25023] More detailed security guidance for K8S

2018-11-13 Thread rvesse
Github user rvesse commented on the issue: https://github.com/apache/spark/pull/23013 @tgravescs Re: Point 1 I have a separate PR #22904 which makes some improvements to the docs around that point --- - To unsubscri

[GitHub] spark issue #23013: [SPARK-25023] More detailed security guidance for K8S

2018-11-13 Thread rvesse
Github user rvesse commented on the issue: https://github.com/apache/spark/pull/23013 @mccheah I have tried to keep it minimal and just point to the official K8S docs. Obviously there is a balance to be had between high level warnings and detailed advice. K8S is still a relatively n

[GitHub] spark issue #23013: [SPARK-25023] More detailed security guidance for K8S

2018-11-12 Thread mccheah
Github user mccheah commented on the issue: https://github.com/apache/spark/pull/23013 I'm curious as to how much specific K8s guidance we should be giving in Spark documentation. There is such a thing as over-documenting; though we should certainly bias towards writing more documenta

[GitHub] spark issue #23013: [SPARK-25023] More detailed security guidance for K8S

2018-11-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23013 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98729/ Test PASSed. ---

[GitHub] spark issue #23013: [SPARK-25023] More detailed security guidance for K8S

2018-11-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23013 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #23013: [SPARK-25023] More detailed security guidance for K8S

2018-11-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23013 **[Test build #98729 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98729/testReport)** for PR 23013 at commit [`5f2fe6e`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #23013: [SPARK-25023] More detailed security guidance for K8S

2018-11-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23013 **[Test build #98729 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98729/testReport)** for PR 23013 at commit [`5f2fe6e`](https://github.com/apache/spark/commit/5f

[GitHub] spark issue #23013: [SPARK-25023] More detailed security guidance for K8S

2018-11-12 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/23013 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spa

[GitHub] spark issue #23013: [SPARK-25023] More detailed security guidance for K8S

2018-11-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23013 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23013: [SPARK-25023] More detailed security guidance for K8S

2018-11-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23013 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23013: [SPARK-25023] More detailed security guidance for K8S

2018-11-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23013 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional