Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91870/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91870 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91870/testReport)**
for PR 21366 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91866/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91866 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91866/testReport)**
for PR 21366 at commit
Github user mccheah commented on the issue:
https://github.com/apache/spark/pull/21366
Ok, I'm merging to master. Thanks everyone for contributing to review -
@foxish, @liyinan926 , @skonto , @dvogelbacher, @erikerlandson. As discussed
earlier, I will post a design document for how
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3898/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/156/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3898/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4047/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91870 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91870/testReport)**
for PR 21366 at commit
Github user mccheah commented on the issue:
https://github.com/apache/spark/pull/21366
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3895/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/153/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4044/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3895/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/21366
@mccheah thnx a lot better with the comments. +1
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91866 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91866/testReport)**
for PR 21366 at commit
Github user mccheah commented on the issue:
https://github.com/apache/spark/pull/21366
Ok, addressed comments. The latest patch also makes it so that the
subscribers run in a thread pool instead of just on a single thread. We have
two subscribers so now they can run concurrently, if
Github user foxish commented on the issue:
https://github.com/apache/spark/pull/21366
If last round's comments are addressed, LGTM from me. Important behavior to
check is - the snapshot, and creating replacement executors based on captured
snapshot.
---
Github user dvogelbacher commented on the issue:
https://github.com/apache/spark/pull/21366
Agree with @mccheah on not blocking this on a design doc. This PR strictly
improves the management of executor states in k8s compared to how it was done
before. So we really should get this
Github user Silberlocke commented on the issue:
https://github.com/apache/spark/pull/21366
Agree with @mccheah on not blocking this on a design doc. This PR strictly
improves the management of executor states in k8s compared to how it was done
before. So we really should get this
Github user mccheah commented on the issue:
https://github.com/apache/spark/pull/21366
> @mccheah could you add a design doc for future reference and so that new
contributors can understand better the rationale behind this. There is some
description in the JIRA ticket but not enough
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/21366
@mccheah could you add a design doc for future reference and so that new
contributors can understand better the rationale behind this. There is some
description in the JIRA ticket but not enough to
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91731/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91731 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91731/testReport)**
for PR 21366 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91727/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91727 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91727/testReport)**
for PR 21366 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91728/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91728 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91728/testReport)**
for PR 21366 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3807/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3807/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/65/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3804/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3954/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3951/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3804/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3803/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91731 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91731/testReport)**
for PR 21366 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/62/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3803/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3950/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91728 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91728/testReport)**
for PR 21366 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91727 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91727/testReport)**
for PR 21366 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/61/
Github user mccheah commented on the issue:
https://github.com/apache/spark/pull/21366
Latest change removes the dependency on rxjava.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91588/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91588 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91588/testReport)**
for PR 21366 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91583/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91583 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91583/testReport)**
for PR 21366 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91582/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91582 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91582/testReport)**
for PR 21366 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3723/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3868/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3723/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3720/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91588 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91588/testReport)**
for PR 21366 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3720/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3865/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3719/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91583 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91583/testReport)**
for PR 21366 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3864/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/3719/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91582 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91582/testReport)**
for PR 21366 at commit
Github user mccheah commented on the issue:
https://github.com/apache/spark/pull/21366
Ok, addressed @dvogelbacher's comments. Also changed the subscribers to be
given the whole buffer, and the subscribers can choose for some operations to
be done on a per-snapshot basis but other
Github user dvogelbacher commented on the issue:
https://github.com/apache/spark/pull/21366
good catch @mccheah those kind of things weren't handled by the first
approach.
I like the new one it's basically declarative in saying `state=snapshot
from k8s` (plus optimizing with
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91547/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91547 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91547/testReport)**
for PR 21366 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91548/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91548 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91548/testReport)**
for PR 21366 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91545/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91545 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91545/testReport)**
for PR 21366 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91544/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21366
**[Test build #91544 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91544/testReport)**
for PR 21366 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91543/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21366
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
1 - 100 of 111 matches
Mail list logo