Github user liyinan926 commented on the issue:
https://github.com/apache/spark/pull/22146
To pick this up, I think we need to reach an agreement on which way to go
for selecting the Spark container in the pod. I agree that it's clearer to use
a configuration option to specifically
Github user tnachen commented on the issue:
https://github.com/apache/spark/pull/22146
The PR works for me now as well for adding volumes to executors.
---
-
To unsubscribe, e-mail:
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/22146
@onursatici I tried the PR and it works so far. We can keep the convention
let's hope users will be careful.Would it possible to add some tests like
sidecar tests to examine containers setup etc.
Github user onursatici commented on the issue:
https://github.com/apache/spark/pull/22146
@mccheah @erikerlandson @skonto should we keep the container selection
logic here, or should we revert back to having a configuration value for
pinning spark container names, either by name of
Github user liyinan926 commented on the issue:
https://github.com/apache/spark/pull/22146
@mccheah @erikerlandson given that banch-2.4 has already been cut, we have
more flexibility in terms of timing of getting this in, as well as more space
for thoughts to get this right. I don't
Github user mccheah commented on the issue:
https://github.com/apache/spark/pull/22146
I think we still need some consensus on the driver container API.
Personally I think it's clearer to use a configuration option to specifically
select the container that is the driver, but this is
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2842/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95679/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95679 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95679/testReport)**
for PR 22146 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2842/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95679 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95679/testReport)**
for PR 22146 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2747/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95553/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2747/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95553 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95553/testReport)**
for PR 22146 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95553 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95553/testReport)**
for PR 22146 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95547/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95547 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95547/testReport)**
for PR 22146 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2741/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2741/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95547 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95547/testReport)**
for PR 22146 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2738/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95542 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95542/testReport)**
for PR 22146 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95542/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2738/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95542 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95542/testReport)**
for PR 22146 at commit
Github user erikerlandson commented on the issue:
https://github.com/apache/spark/pull/22146
+1 for @skonto recommendation about CI testing templates populated with
larger numbers of fields, and template errors
---
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/22146
@onursatici we need to test what works and what does not, there are a
number of properties mentioned in the design doc. I would like to see how
things play if you have a full pod spec with many
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2697/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95461/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95461 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95461/testReport)**
for PR 22146 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2697/
---
Github user onursatici commented on the issue:
https://github.com/apache/spark/pull/22146
@tnachen I have added a test for additional volumes here:
https://github.com/apache/spark/pull/22146/commits/8b8aa48927aa35ba3683ea7eaed093a570721143
and this seems to pass locally.
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95461 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95461/testReport)**
for PR 22146 at commit
Github user tnachen commented on the issue:
https://github.com/apache/spark/pull/22146
I've been looking to mount additional volumes to the executor containers
and just tried out the PR.
It doesn't seem possible since if you add the container in the pod
template,
Github user onursatici commented on the issue:
https://github.com/apache/spark/pull/22146
@mccheah @erikerlandson @liyinan926 @ifilonenko @skonto this pr is ready
for a final review. I am only planning to add one integration test for
malformed templates, if I can find a non intrusive
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2687/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95442/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95442 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95442/testReport)**
for PR 22146 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2687/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95442 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95442/testReport)**
for PR 22146 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95417/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95417 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95417/testReport)**
for PR 22146 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2676/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95424/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95424 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95424/testReport)**
for PR 22146 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2676/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95424 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95424/testReport)**
for PR 22146 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95414/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95414 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95414/testReport)**
for PR 22146 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2669/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2669/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95417 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95417/testReport)**
for PR 22146 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2666/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2666/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95414 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95414/testReport)**
for PR 22146 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95392/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95392 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95392/testReport)**
for PR 22146 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2651/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2651/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2649/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/2649/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95392 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95392/testReport)**
for PR 22146 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95391/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95391 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95391/testReport)**
for PR 22146 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22146
**[Test build #95391 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95391/testReport)**
for PR 22146 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22146
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95346/
Test FAILed.
---
101 - 200 of 275 matches
Mail list logo
