Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/17120
LGTM. Merging to master.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17120
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74260/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17120
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17120
**[Test build #74260 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74260/testReport)**
for PR 17120 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17120
**[Test build #74260 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74260/testReport)**
for PR 17120 at commit
Github user lw-lin commented on the issue:
https://github.com/apache/spark/pull/17120
Jenkins retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17120
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17120
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74245/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17120
**[Test build #74245 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74245/testReport)**
for PR 17120 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17120
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74236/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17120
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17120
**[Test build #74236 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74236/testReport)**
for PR 17120 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17120
**[Test build #74236 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74236/testReport)**
for PR 17120 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17120
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17120
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74062/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17120
**[Test build #74062 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74062/testReport)**
for PR 17120 at commit
Github user lw-lin commented on the issue:
https://github.com/apache/spark/pull/17120
Jenkins retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17120
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73900/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17120
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17120
**[Test build #73900 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73900/testReport)**
for PR 17120 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17120
**[Test build #73900 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73900/testReport)**
for PR 17120 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17120
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73885/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17120
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17120
**[Test build #73885 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73885/testReport)**
for PR 17120 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17120
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73884/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17120
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17120
**[Test build #73884 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73884/testReport)**
for PR 17120 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17120
**[Test build #73885 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73885/testReport)**
for PR 17120 at commit
Github user lw-lin commented on the issue:
https://github.com/apache/spark/pull/17120
Thank you @marmbrus @steveloughran for the feedback. Added some explicit
docs. Here's a screenshot of the affected section from the programming guide:
Github user lw-lin commented on the issue:
https://github.com/apache/spark/pull/17120
Thank you @marmbrus @steveloughran for the feedback. I've added some
explicit docs. Here's a screenshot of the affected section from the programming
guide:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17120
**[Test build #73884 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73884/testReport)**
for PR 17120 at commit
Github user marmbrus commented on the issue:
https://github.com/apache/spark/pull/17120
Note streams can be very long running, so this isn't about some short
window. It could even be that I'm moving to a different bucket (but don't want
to loose my exactly once guarantees of a very
Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/17120
I know that's the *current* use case, but I'm thinking about future
confusion, especially as the use case you espoused, "move from s3n to s3a
within the same window" isn't likely to be that
Github user marmbrus commented on the issue:
https://github.com/apache/spark/pull/17120
The use case here is when you have truly unique filenames (i.e. they
contain a guid). This is actually pretty common in my experience. We
definitely shouldn't turn this on by default, but as
Github user lw-lin commented on the issue:
https://github.com/apache/spark/pull/17120
@steveloughran thanks for the comments.
@marmbrus @zsxwing it'd be great if you could share some thoughts!
---
If your project is set up for it, you can reply to this email and have your
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17120
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73691/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17120
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17120
**[Test build #73691 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73691/testReport)**
for PR 17120 at commit
Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/17120
-1, non binding
I understand the rationale for this, to aid migration from s3/s3n to s3a,
but given the need is schema independence, you should be using the full path
name from
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17120
**[Test build #73691 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73691/testReport)**
for PR 17120 at commit
40 matches
Mail list logo
