Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #97774 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97774/testReport)**
for PR 21123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97700/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97706/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #97738 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97738/testReport)**
for PR 21123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97738/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #97700 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97700/testReport)**
for PR 21123 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #97706 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97706/testReport)**
for PR 21123 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #97738 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97738/testReport)**
for PR 21123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #97706 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97706/testReport)**
for PR 21123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #97700 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97700/testReport)**
for PR 21123 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21123
@rdblue I really appreciate your work for adding these new logical plans,
and they are indeed incremental: when you add `AppendData`, you change
`DataFrameWriter` to only create `AppendData` if
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/21123
> We should do things incrementally and always prepare for the worst case.
This is why I'm pushing for Append support and adding interfaces to finish
the logical plans. Releasing logical
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/21123
> this mapping is not mentioned in the logical plan standardization design
doc and I doubt if it's doable
I agree! This is why I propose we add an entirely new API for v2 with clear
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21123
Yea I agree. I was just wondering if we plan similar stuff for all
datasource v1 not only FileFormat one since it looks the reason described above
potentially apply to all datasource v1 I
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21123
v1 fallback should be used as a temporary workaround, not a long-term
solution to fix the gap between v1 and v2.
---
-
To
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21123
BTW, do we consider Datasource V1 fallback too?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21123
This PR needs to be rebased once #22009 gets in.
> I think that PR should remove SaveMode and should always use the new
logical plans for v2 operations.
I don't agree according
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21123
@gatorsmile Yea, it shouldn't break the compatibility for now for the
reasons described in the PR I guess.
@rdblue, however, strictly isn't that specific to Datasource V2, or did I
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/21123
@gatorsmile, I agree. The new logical plans should clean up cases where
behavior is ambiguous, examples of which are pointed out in the background of
that SPIP.
The problem I'm referring to
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21123
@HyukjinKwon @rdblue V2 data source APIs should not break FileFormat V1
compatibility, IMO. Based on my experience, it is not a right thing to force
users to change their Spark applications for
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/21123
@HyukjinKwon, I don't think there has been a discussion about how v1 and v2
compatibility will work. Discussion on #22009 brought up one aspect of it:
whether v2 sources should be passed a
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21123
I am sorry if I missed something but would you please kindly point out
where the discussion about Datasource V2 and FileFormat V1 compatibility is
going on?
---
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21123
Please do not merge this PR. The major API changes of dsv2 will be sent
soon.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93422/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #93422 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93422/testReport)**
for PR 21123 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #93422 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93422/testReport)**
for PR 21123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21123
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user gengliangwang commented on the issue:
https://github.com/apache/spark/pull/21123
@cloud-fan is going to update the data source V2 read path:
https://issues.apache.org/jira/browse/SPARK-24882
I will update the file source base on it .
---
Github user tengpeng commented on the issue:
https://github.com/apache/spark/pull/21123
Any updates on this PR? Yes, I know this is a temporary hack, but without
it being merged, it is not possible to migrate other data sources to V2
(experimentally).
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89784/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #89784 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89784/testReport)**
for PR 21123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2629/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #89784 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89784/testReport)**
for PR 21123 at commit
Github user gengliangwang commented on the issue:
https://github.com/apache/spark/pull/21123
retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89776/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #89776 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89776/testReport)**
for PR 21123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2623/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #89776 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89776/testReport)**
for PR 21123 at commit
Github user gengliangwang commented on the issue:
https://github.com/apache/spark/pull/21123
retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #89767 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89767/testReport)**
for PR 21123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89767/
Test FAILed.
---
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21123
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2615/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #89767 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89767/testReport)**
for PR 21123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89764/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #89764 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89764/testReport)**
for PR 21123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2612/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #89764 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89764/testReport)**
for PR 21123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89734/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #89734 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89734/testReport)**
for PR 21123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2596/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #89734 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89734/testReport)**
for PR 21123 at commit
Github user gengliangwang commented on the issue:
https://github.com/apache/spark/pull/21123
retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89732/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #89732 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89732/testReport)**
for PR 21123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89725/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #89725 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89725/testReport)**
for PR 21123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89724/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #89724 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89724/testReport)**
for PR 21123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89717/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #89717 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89717/testReport)**
for PR 21123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2595/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89716/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #89732 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89732/testReport)**
for PR 21123 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #89716 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89716/testReport)**
for PR 21123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2590/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #89725 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89725/testReport)**
for PR 21123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2589/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21123
**[Test build #89724 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89724/testReport)**
for PR 21123 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21123
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
1 - 100 of 118 matches
Mail list logo
