Re: Iceberg 0.12.0 Release Plan

2021-08-02 Thread Carl Steinbach
Hi Jack, I added #2887 to the 0.12.0 release project board . When do you think this patch will be committed? - Carl On Mon, Aug 2, 2021 at 4:28 PM Ryan Blue wrote: > Jack, I've been reviewing that one so that we can get it in. Thanks for > fixing i

Re: Iceberg 0.12.0 Release Plan

2021-08-02 Thread Ryan Blue
Jack, I've been reviewing that one so that we can get it in. Thanks for fixing it! On Mon, Aug 2, 2021 at 3:12 PM Jack Ye wrote: > Thanks for the update Carl! > > Given that we have voted for the adoption of format v2, can we also get > this change in, so that people can start to use v2 tables?

Re: Iceberg 0.12.0 Release Plan

2021-08-02 Thread Jack Ye
Thanks for the update Carl! Given that we have voted for the adoption of format v2, can we also get this change in, so that people can start to use v2 tables? https://github.com/apache/iceberg/pull/2887 -Jack On Mon, Aug 2, 2021 at 3:08 PM Carl Steinbach wrote: > I want to provide everyone wit

Re: Iceberg 0.12.0 Release Plan

2021-08-02 Thread Carl Steinbach
I want to provide everyone with a quick update on the 0.12.0 release process. At this point, #2906 Fix Partition field IDs in table replacement is the only remaining blocker. Ryan is working on a fix and predicts that we'll be ready to cut the first rel

Re: shaded/unshaded packages in runtime/non-runtime jars

2021-08-02 Thread Russell Spitzer
I think you have two options, Use the unshaded iceberg jar and reshade your resultant app so that it is shaded identically to iceberg-spark3-runtime, Compile against the shaded iceberg-spark-3 runtime jar and shaded parquet libs On Mon, Aug 2, 2021 at 2:28 PM Huadong Liu wrote: > Hi, > > I hav

shaded/unshaded packages in runtime/non-runtime jars

2021-08-02 Thread Huadong Liu
Hi, I have a Java app that writes Iceberg files with the core API. As a result, it uses the unshaded parquet package. I am now extending the app to read the table with Spark. Unfortunately the iceberg-spark3-runtime uses the shaded parquet package and I am getting: *java.lang.ClassCastException:

[RESULT] [VOTE] Adopt the v2 spec changes

2021-08-02 Thread Ryan Blue
With 10 +1 votes and no +0 or -1 votes, this passes. Thanks, everyone for looking into the format changes and taking the time to vote! And thanks to everyone that worked on getting v2 implemented, tested, and documented! I'll put up some PRs to reflect this change in the spec. Ryan On Sun, Aug

Re: Orc deletes

2021-08-02 Thread Peter Vary
Created https://github.com/apache/iceberg/issues/2914 so we can track the missing parts. Tried to collect the things I have seen, but any help would be good. Thanks, Peter > On Aug 2, 2021, at 07:28, Anton Okolnychyi > wrote: > > No blockers I