Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22573
**[Test build #97805 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97805/testReport)**
for PR 22573 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22573
**[Test build #97765 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97765/testReport)**
for PR 22573 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22573
**[Test build #97748 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97748/testReport)**
for PR 22573 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22573
**[Test build #97765 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97765/testReport)**
for PR 22573 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22573
**[Test build #97748 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97748/testReport)**
for PR 22573 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22573
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22573
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/22573
@dongjoon-hyun, Iceberg schema evolution is based on the field IDs, not on
names. The current table schema's names are the runtime names for columns in
that table, and all reads happen by first
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22573
Thank you, @rdblue . BTW, in general, indexing might be unsafe in Apache
Spark when Metastore Schema is different from File Schema. Does it assume
schema evolution feature in `IceBerg`?
---
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/22573
The approach we've taken in Iceberg is to allow `.` in names by using an
index in the top-level schema. The full path of every leaf in the schema is
produced and added to a map from the full field
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22573
That's great!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/22573
Updating `Filter` APIs sounds reasonable to me. This should be part of our
data source API v2. cc @cloud-fan @rxin @rdblue
---
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22573
Can we update public `Filter` API in Spark 3.0.0? @cloud-fan and
@gatorsmile .
---
-
To unsubscribe, e-mail:
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/22573
I was thinking to change the APIs in `Filter` so we can represent nested
fields easier, but also realized that it's a stable public interface.
Without changing the interface of `Filter`, we
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22573
I think the problem is, the current public `Filter` API uses string as the
attribute type, which is hard to represent nested fields.
Ideally we should extend the API, create a new
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22573
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22573
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96711/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22573
**[Test build #96711 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96711/testReport)**
for PR 22573 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22573
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22573
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96710/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22573
**[Test build #96710 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96710/testReport)**
for PR 22573 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22573
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22573
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96709/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22573
**[Test build #96709 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96709/testReport)**
for PR 22573 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22573
**[Test build #96711 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96711/testReport)**
for PR 22573 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22573
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22573
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22573
**[Test build #96710 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96710/testReport)**
for PR 22573 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22573
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22573
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22573
**[Test build #96709 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96709/testReport)**
for PR 22573 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22573
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/22573
@gatorsmile @cloud-fan @dongjoon-hyun @viirya
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22573
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
34 matches
Mail list logo
