gh-yzou commented on code in PR #1857:
URL: https://github.com/apache/polaris/pull/1857#discussion_r2150666614
##########
site/content/in-dev/unreleased/polaris-spark-client.md:
##########
@@ -128,3 +128,21 @@ The Polaris Spark client has the following functionality
limitations:
3) Rename a Delta table is not supported.
4) ALTER TABLE ... SET LOCATION is not supported for DELTA table.
5) For other non-Iceberg tables like csv, it is not supported.
+
+## Iceberg Spark Client compatibility with Polaris Spark Client
+The Polaris Spark client today is not designed to be used with Iceberg Spark
client together. In other words,
Review Comment:
@dimas-b and @adutra i have an update here.
```
I believe the non-bundled jar will work well for automated downloads only if
it declares all runtime dependencies. I
```
Yes, that is actually the case, i think I made some mistake in my previous
testing. The release today actually already works for both ways:
1) --packages
org.apache.polaris:polaris-spark-3.5_2.12:0.11.0-beta-incubating-SNAPSHOT
2) or use --jars
polaris-spark-3.5_2.12-0.11.0-beta-incubating-SNAPSHOT-bundle.jar
I have double confirmed this in couple of ways. So I think we can keep the
current clarssifier to produce the bundle jar, i can update this PR as an
improvement to remove my previous maven hack to reuse the shadow jar. However,
I do not think that should be a blocker for 1.0. cc @flyrain
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
