Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/20675
@HeartSaVioR Thanks for your reply, sorry for just seen your comment. Yep,
will keep tracking this feature after we supports shuffled stateful operators.
---
Github user HeartSaVioR commented on the issue:
https://github.com/apache/spark/pull/20675
Looks like the patch is outdated, and when continuous query supports
shuffled stateful operators, implementing task level retry is not that trivial.
To get correct result of aggregation, when
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/20675
> it just means that for very long-running streams task restarts will
eventually run out.
Ah, I know your means. Yeah, if we support task level retry we should also
set the task retry
Github user jose-torres commented on the issue:
https://github.com/apache/spark/pull/20675
It's not semantically wrong that the attempt number is never reset; it just
means that for very long-running streams task restarts will eventually run out.
You make a good point that in
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/20675
Great thanks for your detailed reply!
> The semantics aren't quite right. Task-level retry can happen a fixed
number of times for the lifetime of the task, which is the lifetime of the
Github user jose-torres commented on the issue:
https://github.com/apache/spark/pull/20675
Now that I think about it, we may eventually need a way to set the starting
partition offset after creation for other reasons, so I'm less confident in
those second and third reasons. But on
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20675
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87666/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20675
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20675
**[Test build #87666 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87666/testReport)**
for PR 20675 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20675
**[Test build #87666 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87666/testReport)**
for PR 20675 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20675
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20675
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1054/
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/20675
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20675
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87665/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20675
**[Test build #87665 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87665/testReport)**
for PR 20675 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20675
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/20675
cc @tdas and @jose-torres
#20225 gives a quickly fix for task level retry, this is just an attempt
for a maybe better implementation. Please let me know if I do something wrong
or have
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20675
**[Test build #87665 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87665/testReport)**
for PR 20675 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20675
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1053/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20675
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
20 matches
Mail list logo
