Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/19404
I think the sync is important, but that you just need to handle the case of
"fs doesn't support it".
Thinking about this a bit more, I didn't like my proposed patch. Better to
have
Github user rekhajoshm commented on the issue:
https://github.com/apache/spark/pull/19404
Thanks for the good inputs.Closing this PR.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/19404
BTW, perf wise: hflush() is required to block until the flush has got to
the store (visible to others), and with hsync actually saved to the durable
store. So it will take time, but if you
Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/19404
Problem here is that a stream which doesn't implement hflush/hsync is
required to throw an exception; it's a way of guaranteeing that if hsync/hflush
does complete, the action has done what
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/19404
@steveloughran what do you think of this?
flushing sounds safe but is there a performance impact here if done on
every `serialize`?
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19404
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19404
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82439/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19404
**[Test build #82439 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82439/testReport)**
for PR 19404 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19404
**[Test build #82439 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82439/testReport)**
for PR 19404 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19404
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19404
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82434/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19404
**[Test build #82434 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82434/testReport)**
for PR 19404 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19404
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19404
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82433/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19404
**[Test build #82433 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82433/testReport)**
for PR 19404 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19404
**[Test build #82434 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82434/testReport)**
for PR 19404 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19404
**[Test build #82433 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82433/testReport)**
for PR 19404 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19404
**[Test build #3940 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3940/testReport)**
for PR 19404 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19404
**[Test build #3940 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3940/testReport)**
for PR 19404 at commit
Github user rekhajoshm commented on the issue:
https://github.com/apache/spark/pull/19404
Seems to be apache spark git/jenkins issue.Please retest after a
while.thanks
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19404
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82359/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19404
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
22 matches
Mail list logo
