Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/23208
Let's move the high level discussion to the doc:
https://docs.google.com/document/d/1vI26UEuDpVuOjWw4WPoH2T6y8WAekwtI7qoowhOFnI4/edit?usp=sharing
---
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/23208
@cloud-fan, what are you suggesting to use as a design? If you think this
shouldn't mirror the read side, then let's be clear on what it should look
like. Maybe that's a design doc, or maybe that's
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/23208
@rdblue I tried to add `WriteBuilder`, but there is a difference between
read and write:
1. for read, the `ScanBuilder` can collect many information, like column
pruning, filter pushdown,
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/23208
@cloud-fan, I see that this adds `Table` and uses `TableProvider`, but I
was expecting this to also update the write side to mirror the read side, like
PR #22190 for
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/23208
Thanks for posting this PR @cloud-fan! I'll have a look in the next day or
so.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23208
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99620/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23208
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23208
**[Test build #99620 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99620/testReport)**
for PR 23208 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23208
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23208
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23208
**[Test build #99620 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99620/testReport)**
for PR 23208 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/23208
cc @rdblue @rxin @jose-torres @gatorsmile @HyukjinKwon @gengliangwang
---
-
To unsubscribe, e-mail:
12 matches
Mail list logo
