Thanks for the update Carl! Given that we have voted for the adoption of format v2, can we also get this change in, so that people can start to use v2 tables? https://github.com/apache/iceberg/pull/2887
-Jack On Mon, Aug 2, 2021 at 3:08 PM Carl Steinbach <c...@apache.org> wrote: > I want to provide everyone with a quick update on the 0.12.0 release > process. At this point, #2906 Fix Partition field IDs in table replacement > <https://github.com/apache/iceberg/pull/2906> is the only remaining > blocker. Ryan is working on a fix and predicts that we'll be ready to cut > the first release candidate by the end of this week. > > - Carl > > On Mon, Jul 19, 2021 at 2:58 PM Szehon Ho <szehon.apa...@gmail.com> wrote: > >> Hi Carl, >> >> For the Issue: https://github.com/apache/iceberg/issues/2783 >> >> The status is: I gave a bit of a try but couldn’t find an easy fix, so >> hoping someone more knowledgable about this code has cycle to take a look >> at it. >> >> It would be great to fix it for 0.12 as it seems to block more metadata >> queries than before, but for timing purpose I’m not sure if its feasible. >> >> Thanks >> Szehon >> >> On Mon, Jul 19, 2021 at 2:19 PM Carl Steinbach <c...@apache.org> wrote: >> >>> Hi Everyone, >>> >>> Currently, there are three issues blocking the release of 0.12.0: >>> >>> >>> 1. #2308 Handle the case that RewriteFiles and RowDelta commit the >>> transaction at the same time >>> <https://github.com/apache/iceberg/issues/2308> >>> 2. #2783 Metadata Table Empty Projection - Unknown type for int >>> field. Type name: java.lang.string >>> <https://github.com/apache/iceberg/issues/2783> >>> 3. #2284 Core: reassign the partition field IDs and reuse any >>> existing ID <https://github.com/apache/iceberg/pull/2284>s >>> >>> #2284 is in review. >>> >>> Ryan said he would take a look at #2308. >>> >>> @Szehon Ho <sze...@cloudera.com>, can you please confirm whether or not >>> you're working on #2783? >>> >>> Thanks. >>> >>> - Carl >>> >>> >>> >>> On Mon, Jul 19, 2021 at 12:31 PM Jack Ye <yezhao...@gmail.com> wrote: >>> >>>> I haven't heard any news for the 0.12.0 release since then, are we >>>> still planning for the release? >>>> >>>> Please let me know if there is anything we can do to help speed up the >>>> process. (I just saw the release board, will try to at least review those >>>> PRs) >>>> >>>> Best, >>>> Jack Ye >>>> >>>> On Mon, Jul 12, 2021 at 5:41 PM Sreeram Garlapati < >>>> gsreeramku...@gmail.com> wrote: >>>> >>>>> Great, thanks Ryan. >>>>> >>>>> On Mon, Jul 12, 2021 at 5:17 PM Ryan Blue <b...@tabular.io> wrote: >>>>> >>>>>> Sreeram, I was just waiting for tests to pass on that PR. I just >>>>>> merged it. >>>>>> >>>>>> On Mon, Jul 12, 2021 at 4:41 PM Sreeram Garlapati < >>>>>> gsreeramku...@gmail.com> wrote: >>>>>> >>>>>>> Hi Carl, >>>>>>> >>>>>>> Thanks a lot for managing 0.12.0 release. >>>>>>> >>>>>>> Can you also pl. add this PR: >>>>>>> https://github.com/apache/iceberg/pull/2752 - which adds the option >>>>>>> "streaming-skip-delete-snapshots" - to Spark3 micro_batch reader. >>>>>>> Without this, streaming reads will fail if a snapshot of type delete or >>>>>>> replace is encountered, & is pretty much unusable. This PR is already >>>>>>> approved by multiple Committers - Ryan and Russell. >>>>>>> >>>>>>> PS: I am unsure if new PRs will be merged apart from the list >>>>>>> proposed on the project board - into the *0.12.0* release, and >>>>>>> hence, proposing this. If this PR will be merged - no action is needed. >>>>>>> pl. >>>>>>> pardon my ignorance. >>>>>>> >>>>>>> Best regards, >>>>>>> Sreeram >>>>>>> >>>>>>> On Mon, Jul 12, 2021 at 4:14 PM Carl Steinbach <c...@tabular.io> >>>>>>> wrote: >>>>>>> >>>>>>>> Hi Grant, >>>>>>>> >>>>>>>> Good catch! I added PR-1648 >>>>>>>> <https://github.com/apache/iceberg/pull/1648> to the 0.12.0 >>>>>>>> project board. >>>>>>>> >>>>>>>> - Carl >>>>>>>> >>>>>>>> On Mon, Jul 12, 2021 at 1:16 PM Grant Nicholas <gr...@spothero.com> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> Howdy! Any updates on PR-1648 >>>>>>>>> <https://github.com/apache/iceberg/pull/1648> which upgrades the >>>>>>>>> avro version used in iceberg? I do not see it in the "To-Do" section >>>>>>>>> linked >>>>>>>>> above, but the older avro version has caused major problems described >>>>>>>>> in >>>>>>>>> this issue and it would be nice to get in 0.12.0. >>>>>>>>> https://github.com/apache/iceberg/issues/1654 >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> On Mon, Jul 12, 2021 at 2:39 PM Carl Steinbach <c...@apache.org> >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>>> Hi Everyone, >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> I volunteered to be the release manager for the 0.12.0 release. >>>>>>>>>> My goal is to start cutting release candidates this Friday, 7/17 at >>>>>>>>>> 24:00 >>>>>>>>>> PST. I am tracking progress on this release on the Release >>>>>>>>>> 0.12.0 Project Board >>>>>>>>>> <https://github.com/apache/iceberg/projects/1>. Note that this >>>>>>>>>> board only tracks issues that BLOCK the release. >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> There are currently 7 PRs listed in the To-Do >>>>>>>>>> <https://github.com/apache/iceberg/projects/1#column-14786627> >>>>>>>>>> column. I am going to remove these PRs from the 0.12.0 release >>>>>>>>>> tomorrow, >>>>>>>>>> 7/13 at 24:00 PST, unless they are updated with the following >>>>>>>>>> information: >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> 1) Why does the PR need to be included in the 0.12.0 release? >>>>>>>>>> >>>>>>>>>> 2) When will the PR will be ready for review? >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> If you have any questions or concerns, please get in touch with >>>>>>>>>> me over email or slack. >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> Thanks. >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> - Carl >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> >>>>>>>>> [image: SpotHero] <http://spothero.com/> >>>>>>>>> >>>>>>>>> Grant Nicholas / Senior Data Engineer II >>>>>>>>> Pronouns <https://lgbt.ucsf.edu/pronounsmatter>: he/his >>>>>>>>> gr...@spothero.com >>>>>>>>> spothero.com <http://www.spothero.com/> | LinkedIn >>>>>>>>> <https://www.linkedin.com/in/grantanicholas> >>>>>>>>> *Your perfect spot is waiting for you! Learn more >>>>>>>>> at spothero.com/careers <http://spothero.com/careers>* >>>>>>>>> >>>>>>>> >>>>>> >>>>>> -- >>>>>> Ryan Blue >>>>>> Tabular >>>>>> >>>>>
