Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/20490
This is the writing code I was talking about:
```
// write the data and commit this writer.
Utils.tryWithSafeFinallyAndFailureCallbacks(block = {
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87338/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87338 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87338/testReport)**
for PR 20490 at commit
Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/20490
@rdblue thanks. That was what I thought (the output coordinator doesn't
tell incoming speculative work to abort until any actively committing task
attempt has returned, I was just worried
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/20490
Accidentally closed & reopened. Oops.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/20490
@cloud-fan, I don't think we can rely on user code propagating
`InterruptedException`. How to handle that exception in particular is one of
the least understood parts of the JVM.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87338 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87338/testReport)**
for PR 20490 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/811/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/20490
AFAIK, there is no KILL mechanism for speculative tasks, which means, if
multiple task attempts are running at the same time and one of them finishes
earlier, the others will keep running until
Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/20490
Been having talks with colleagues last week and want to check something.
How exactly do Spark executors abort speculative jobs without waiting for
them get into the ready-to-commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/20490
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87269/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87269 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87269/testReport)**
for PR 20490 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87269 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87269/testReport)**
for PR 20490 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/756/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87244/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87244 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87244/testReport)**
for PR 20490 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87244 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87244/testReport)**
for PR 20490 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/737/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/20490
just type "retest this please"
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/20490
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/20490
The test failure doesn't look related to these changes to me. How can I get
on the list to ask jenkins to retest a PR?
---
-
To
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87229/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87229 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87229/testReport)**
for PR 20490 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87229 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87229/testReport)**
for PR 20490 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/727/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87224/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87224 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87224/testReport)**
for PR 20490 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87224 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87224/testReport)**
for PR 20490 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/722/
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/20490
@cloud-fan, please have another look. I fixed the problems you spotted.
I haven't added support for the streaming side. It is different enough that
I think we should do it in a follow-up.
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/20490
Overall LGTM, I don't have a better idea. also cc @rxin
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87169/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87169 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87169/testReport)**
for PR 20490 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87169 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87169/testReport)**
for PR 20490 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/673/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87132/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87132 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87132/testReport)**
for PR 20490 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87132 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87132/testReport)**
for PR 20490 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/644/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87126/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87126 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87126/testReport)**
for PR 20490 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87126 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87126/testReport)**
for PR 20490 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/640/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87125/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87125 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87125/testReport)**
for PR 20490 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/639/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87125 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87125/testReport)**
for PR 20490 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87078/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87078 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87078/testReport)**
for PR 20490 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/600/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20490
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/20490
I've updated this to no longer require #20387. It wasn't relying on those
changes at all. @gatorsmile, @cloud-fan, what do you think about getting this
into 2.3.0?
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20490
**[Test build #87078 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87078/testReport)**
for PR 20490 at commit
73 matches
Mail list logo
