Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/19269
thx; I'll see about passing it all the way down past FileOutputFormat
---
-
To unsubscribe, e-mail:
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/19269
@steveloughran The current API already supports it.
`WriteSupport.createWriter` takes the option parameter, and
`DataSourceV2Writer` can propagate this option down to the data writer, via
Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/19269
w.r.t init, I'm thinking it's critical to get the
DataframeWriter.extraOptions down the tree. This lets committers be tuned on a
query-by-query basis for things like conflict management,
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/19269
Thanks! Merged to master.
This is just the first commit of the data source v2 write protocol. More
PRs are coming to further improve it.
---
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/19269
It sounds like the initialization stages are missing in the current
protocol API design. We can do it later.
LGTM
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19269
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82910/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19269
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19269
**[Test build #82910 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82910/testReport)**
for PR 19269 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19269
**[Test build #82910 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82910/testReport)**
for PR 19269 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/19269
FYI the latest commit passed the test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19269
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19269
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82904/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19269
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82902/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19269
**[Test build #82904 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82904/testReport)**
for PR 19269 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19269
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19269
**[Test build #82904 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82904/testReport)**
for PR 19269 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19269
**[Test build #82902 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82902/testReport)**
for PR 19269 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19269
**[Test build #82902 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82902/testReport)**
for PR 19269 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19269
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82872/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19269
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19269
**[Test build #82872 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82872/testReport)**
for PR 19269 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19269
**[Test build #82872 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82872/testReport)**
for PR 19269 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19269
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82844/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19269
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19269
**[Test build #82844 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82844/testReport)**
for PR 19269 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19269
**[Test build #82844 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82844/testReport)**
for PR 19269 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19269
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19269
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82829/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19269
**[Test build #82829 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82829/testReport)**
for PR 19269 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19269
**[Test build #82829 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82829/testReport)**
for PR 19269 at commit
30 matches
Mail list logo
