Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23254
Merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23252
(Also, another nit, Spark authentication is not necessarily SASL-based.)
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23221
Merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22904#discussion_r239903144
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/SparkKubernetesClientFactory.scala
---
@@ -67,8 +66,16 @@ private
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23252#discussion_r239898432
--- Diff: core/src/main/scala/org/apache/spark/SecurityManager.scala ---
@@ -380,6 +400,12 @@ private[spark] class SecurityManager
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23252#discussion_r239899856
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/BasicExecutorFeatureStep.scala
---
@@ -112,12 +112,14
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23252#discussion_r23991
--- Diff: core/src/test/scala/org/apache/spark/SecurityManagerSuite.scala
---
@@ -440,12 +473,27 @@ class SecurityManagerSuite extends SparkFunSuite
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23252#discussion_r239900712
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/BasicExecutorFeatureStep.scala
---
@@ -24,7 +24,7 @@ import
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23252#discussion_r239897958
--- Diff: core/src/main/scala/org/apache/spark/SecurityManager.scala ---
@@ -367,11 +372,26 @@ private[spark] class SecurityManager(
case
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23252#discussion_r239900460
--- Diff:
resource-managers/kubernetes/core/src/test/scala/org/apache/spark/deploy/k8s/features/BasicExecutorFeatureStepSuite.scala
---
@@ -158,6 +161,25
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23252#discussion_r239900826
--- Diff: core/src/test/scala/org/apache/spark/SecurityManagerSuite.scala
---
@@ -18,8 +18,11 @@
package org.apache.spark
import
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23174#discussion_r239895212
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/BasicExecutorFeatureStep.scala
---
@@ -87,44 +88,61
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23174#discussion_r239892984
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/BasicExecutorFeatureStep.scala
---
@@ -87,44 +88,61
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23221
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23241#discussion_r239609592
--- Diff: core/src/main/scala/org/apache/spark/io/CompressionCodec.scala ---
@@ -197,4 +201,8 @@ class ZStdCompressionCodec(conf: SparkConf) extends
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23195
Merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22904#discussion_r239272037
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/SparkKubernetesClientFactory.scala
---
@@ -67,8 +66,16 @@ private
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23241
Please use the PR title and summary to describe the solution, not the
problem.
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22904
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22904
add to whitelist
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23195#discussion_r239177994
--- Diff: docs/structured-streaming-kafka-integration.md ---
@@ -624,3 +624,199 @@ For experimenting on `spark-shell`, you can also use
`--packages` to add
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23221
I applied my own feedback to the original PR and will merge pending tests
(since it was already reviewed), unless someone comments first
GitHub user vanzin opened a pull request:
https://github.com/apache/spark/pull/23221
[SPARK-24243][CORE] Expose exceptions from InProcessAppHandle
## What changes were proposed in this pull request?
Adds a new method to SparkAppHandle called getError which returns
GitHub user vanzin opened a pull request:
https://github.com/apache/spark/pull/23220
[SPARK-25877][k8s] Move all feature logic to feature classes.
This change makes the driver and executor builders a lot simpler
by encapsulating almost all feature logic into the respective
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23092
Merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23195#discussion_r238798656
--- Diff: docs/structured-streaming-kafka-integration.md ---
@@ -624,3 +624,57 @@ For experimenting on `spark-shell`, you can also use
`--packages` to add
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23195#discussion_r238798169
--- Diff: docs/structured-streaming-kafka-integration.md ---
@@ -624,3 +624,57 @@ For experimenting on `spark-shell`, you can also use
`--packages` to add
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23195#discussion_r238799671
--- Diff: docs/structured-streaming-kafka-integration.md ---
@@ -624,3 +624,57 @@ For experimenting on `spark-shell`, you can also use
`--packages` to add
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23088
Merging to master / 2.4.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22904#discussion_r238780494
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/SparkKubernetesClientFactory.scala
---
@@ -20,20 +20,22 @@ import
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22904#discussion_r238780744
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/SparkKubernetesClientFactory.scala
---
@@ -67,8 +66,16 @@ private
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23195#discussion_r238776692
--- Diff: docs/structured-streaming-kafka-integration.md ---
@@ -624,3 +624,56 @@ For experimenting on `spark-shell`, you can also use
`--packages` to add
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22904#discussion_r238502012
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/SparkKubernetesClientFactory.scala
---
@@ -67,8 +66,16 @@ private
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22904#discussion_r238484698
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/SparkKubernetesClientFactory.scala
---
@@ -67,8 +66,16 @@ private
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23037
I thought there was already one for that Hive suite failing... SPARK-23622?
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23174
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23174
I looked at the test failure, but the logs weren't super useful. This
passed locally, but let me retrigger here
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23174
> It matters because we're discussing direction
I'm not, you guys are. I'm adding a missing feature with one particular
implementation. If you want to add other implementations that ena
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23037
ok, I give up on flaky tests.
Merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23174
> with the caveat that we merge the subsequent optionality soon
Again, and sorry for pounding on that key, but why does that matter? It has
zero effect on the feature being added h
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23174
I don't understand what you want.
Without this change, auth does not work, period.
With this, users at least have one choice.
If you want to add another choice, you're free
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23174
As I suggested before, any alternative method can be added later. I don't
see why does it need to block this PR
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23191
Merging to 2.4. Please close the PR manually.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23209
Actually I forgot 2.4... there's also a conflict. Seems trivial, so I'll do
it manually and fix the conflict (and run some local tests
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23209
Merging to master / 2.4.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23174
So, can we move forward with this and let any future new feature be handled
in SPARK-26239?
---
-
To unsubscribe, e-mail
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22911
on a non-testing not, any further feedback here?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22911
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22911
there was a seemingly corrupt xml file in the jenkins worker, I removed it
and will retest.
---
-
To unsubscribe, e-mail
Github user vanzin closed the pull request at:
https://github.com/apache/spark/pull/23172
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23172
Merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22904#discussion_r238440694
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/SparkKubernetesClientFactory.scala
---
@@ -67,8 +66,16 @@ private
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22904#discussion_r238439850
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/SparkKubernetesClientFactory.scala
---
@@ -67,8 +66,16 @@ private
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23055
(Belated +1.) Doc update looks fine. The previous one was misleading for
reasons that Ryan explains above, it has nothing to do with whether it's
Windows
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23037
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23088
Also it would be good to open a separate bug to address the fix for SHS /
disk store.
---
-
To unsubscribe, e-mail: reviews
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23088#discussion_r238406928
--- Diff: core/src/main/scala/org/apache/spark/status/AppStatusStore.scala
---
@@ -148,11 +148,20 @@ private[spark] class AppStatusStore
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23088#discussion_r238407621
--- Diff:
core/src/test/scala/org/apache/spark/status/AppStatusStoreSuite.scala ---
@@ -77,6 +77,34 @@ class AppStatusStoreSuite extends SparkFunSuite
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23195#discussion_r238398453
--- Diff: docs/structured-streaming-kafka-integration.md ---
@@ -624,3 +624,56 @@ For experimenting on `spark-shell`, you can also use
`--packages` to add
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23195#discussion_r238399535
--- Diff: docs/structured-streaming-kafka-integration.md ---
@@ -624,3 +624,56 @@ For experimenting on `spark-shell`, you can also use
`--packages` to add
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23195#discussion_r238399808
--- Diff: docs/structured-streaming-kafka-integration.md ---
@@ -624,3 +624,56 @@ For experimenting on `spark-shell`, you can also use
`--packages` to add
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23195#discussion_r238399719
--- Diff: docs/structured-streaming-kafka-integration.md ---
@@ -624,3 +624,56 @@ For experimenting on `spark-shell`, you can also use
`--packages` to add
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23037
Actually I lied.
Could you update the `create_dev_build_context` function in
`docker-image-tool.sh` to copy this new directory? You can run the script from
your build directory to test
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23037
Merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23181
This didn't merge cleanly to 2.4, please open a PR against that branch if
you want it there.
---
-
To unsubscribe, e-mail
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23181
Merging to master / 2.4.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23174
I filed SPARK-26239.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23174
> A proposed scheme is to have
spark.authenticate.k8s.secret.provider=autok8ssecret
If you're going to add a different way to get the auth secret later, then
you can introduce that opt
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23189
Sounds ok.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23174
> The way it's written now
Code can change after it's written...
> If this change is merged into 3.x without any other changes, users will
be forced to use the K8s secret
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23189
> The logWarning call as the other handler below is also not overridden:
It is. I even copied & pasted the code. I made the change locally and this
is what happens:
```
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23174
> while leaving it an exercise for the reader to understand how to properly
run spark such that the secrets are actually secured.
I don't think that's an exercise for the u
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23181#discussion_r237952522
--- Diff:
core/src/test/scala/org/apache/spark/status/AppStatusListenerSuite.scala ---
@@ -1274,47 +1274,69 @@ class AppStatusListenerSuite extends
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23181#discussion_r237952479
--- Diff:
core/src/test/scala/org/apache/spark/status/AppStatusListenerSuite.scala ---
@@ -1274,47 +1274,69 @@ class AppStatusListenerSuite extends
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23189
Actually the problem is here:
```
case e: ClassNotFoundException =>
logWarning(s"Failed to load $childMainClass.", e)
```
That particula
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23055#discussion_r237941472
--- Diff: docs/configuration.md ---
@@ -190,6 +190,8 @@ of the most common options to set are:
and it is up to the application to avoid exceeding
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22598
Merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23055#discussion_r237723350
--- Diff: python/pyspark/worker.py ---
@@ -22,7 +22,12 @@
import os
import sys
import time
-import resource
+# 'resource' is a Unix
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23055#discussion_r237716326
--- Diff: python/pyspark/worker.py ---
@@ -22,7 +22,12 @@
import os
import sys
import time
-import resource
+# 'resource' is a Unix
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23055#discussion_r237714454
--- Diff: python/pyspark/worker.py ---
@@ -22,7 +22,12 @@
import os
import sys
import time
-import resource
+# 'resource' is a Unix
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23055#discussion_r237715129
--- Diff: python/pyspark/worker.py ---
@@ -22,7 +22,12 @@
import os
import sys
import time
-import resource
+# 'resource' is a Unix
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23055#discussion_r237715021
--- Diff: python/pyspark/worker.py ---
@@ -22,7 +22,12 @@
import os
import sys
import time
-import resource
+# 'resource' is a Unix
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22598#discussion_r237659299
--- Diff: core/src/main/scala/org/apache/spark/internal/config/Kafka.scala
---
@@ -0,0 +1,82 @@
+/*
+ * Licensed to the Apache Software Foundation
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23037
When I tried to write automated tests for pyspark in the past it was kind
of a pain. It doesn't work the way you expect unless you have a
pseudo-terminal, apparently.
Maybe try to write
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22598#discussion_r237620523
--- Diff:
core/src/main/scala/org/apache/spark/deploy/security/KafkaTokenUtil.scala ---
@@ -0,0 +1,200 @@
+/*
+ * Licensed to the Apache Software
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22598#discussion_r237620333
--- Diff:
core/src/main/scala/org/apache/spark/internal/config/package.scala ---
@@ -688,4 +688,65 @@ package object config {
.stringConf
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22598#discussion_r237622443
--- Diff:
external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaSecurityHelperSuite.scala
---
@@ -0,0 +1,100
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23151#discussion_r237617706
--- Diff:
core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala ---
@@ -494,13 +494,12 @@ class SparkSubmitSuite
}
test
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23174
(In fact, env variables don't even show up in the UI or event logs, as far
as I can see. Other configs - Spark config, system properties, e.g. - do show
up, and are redacted to mask secrets
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23017
Merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23158
Merging to master / 2.4.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23174
> if the secret would be listed under the environment variables in the
Spark UI
Secrets are redacted in the UI and event logs. We already use env variables
in other contexts (
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22959#discussion_r237587099
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/KubernetesConf.scala
---
@@ -112,125 +72,139 @@ private[spark] case
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/23174
> via a mounted file
> Also the user should be able to specify their own mounted file
The point is that the user shouldn't need to set this at all. You enable
auth, Spark take
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23158#discussion_r237293492
--- Diff:
core/src/test/scala/org/apache/spark/deploy/history/FsHistoryProviderSuite.scala
---
@@ -334,6 +334,42 @@ class FsHistoryProviderSuite extends
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23058#discussion_r237284719
--- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala
---
@@ -718,13 +718,9 @@ private[spark] class BlockManager
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23158#discussion_r237280881
--- Diff:
core/src/test/scala/org/apache/spark/deploy/history/FsHistoryProviderSuite.scala
---
@@ -334,6 +334,42 @@ class FsHistoryProviderSuite extends
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23158#discussion_r237280935
--- Diff:
core/src/test/scala/org/apache/spark/deploy/history/FsHistoryProviderSuite.scala
---
@@ -334,6 +334,42 @@ class FsHistoryProviderSuite extends
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/23172#discussion_r237276972
--- Diff: project/SparkBuild.scala ---
@@ -494,7 +494,12 @@ object KubernetesIntegrationTests {
dockerBuild := {
if (shouldBuildImage
GitHub user vanzin opened a pull request:
https://github.com/apache/spark/pull/23174
[SPARK-26194][k8s] Auto generate auth secret for k8s apps.
This change modifies the logic in the SecurityManager to do two
things:
- generate unique app secrets also when k8s is being
1 - 100 of 11074 matches
Mail list logo
