I just merged the PR. Thanks for making it possible to create v2 tables easily, Jack!
On Tue, Aug 3, 2021 at 1:02 PM Jack Ye <yezhao...@gmail.com> wrote: > Thanks! The PR is mostly ready and just got approved by Anton. As soon as > it is merged we can start the branch cut. > -Jack > > On Mon, Aug 2, 2021 at 11:39 PM Carl Steinbach <cwsteinb...@gmail.com> > wrote: > >> Hi Jack, >> >> I added #2887 to the 0.12.0 release project board >> <https://github.com/apache/iceberg/projects/1>. When do you think this >> patch will be committed? >> >> - Carl >> >> On Mon, Aug 2, 2021 at 4:28 PM Ryan Blue <b...@tabular.io> wrote: >> >>> Jack, I've been reviewing that one so that we can get it in. Thanks for >>> fixing it! >>> >>> On Mon, Aug 2, 2021 at 3:12 PM Jack Ye <yezhao...@gmail.com> wrote: >>> >>>> Thanks for the update Carl! >>>> >>>> Given that we have voted for the adoption of format v2, can we also get >>>> this change in, so that people can start to use v2 tables? >>>> https://github.com/apache/iceberg/pull/2887 >>>> >>>> -Jack >>>> >>>> On Mon, Aug 2, 2021 at 3:08 PM Carl Steinbach <c...@apache.org> wrote: >>>> >>>>> I want to provide everyone with a quick update on the 0.12.0 release >>>>> process. At this point, #2906 Fix Partition field IDs in table >>>>> replacement <https://github.com/apache/iceberg/pull/2906> is the only >>>>> remaining blocker. Ryan is working on a fix and predicts that we'll be >>>>> ready to cut the first release candidate by the end of this week. >>>>> >>>>> - Carl >>>>> >>>>> On Mon, Jul 19, 2021 at 2:58 PM Szehon Ho <szehon.apa...@gmail.com> >>>>> wrote: >>>>> >>>>>> Hi Carl, >>>>>> >>>>>> For the Issue: https://github.com/apache/iceberg/issues/2783 >>>>>> >>>>>> The status is: I gave a bit of a try but couldn’t find an easy fix, >>>>>> so hoping someone more knowledgable about this code has cycle to take a >>>>>> look at it. >>>>>> >>>>>> It would be great to fix it for 0.12 as it seems to block more >>>>>> metadata queries than before, but for timing purpose I’m not sure if its >>>>>> feasible. >>>>>> >>>>>> Thanks >>>>>> Szehon >>>>>> >>>>>> On Mon, Jul 19, 2021 at 2:19 PM Carl Steinbach <c...@apache.org> >>>>>> wrote: >>>>>> >>>>>>> Hi Everyone, >>>>>>> >>>>>>> Currently, there are three issues blocking the release of 0.12.0: >>>>>>> >>>>>>> >>>>>>> 1. #2308 Handle the case that RewriteFiles and RowDelta commit >>>>>>> the transaction at the same time >>>>>>> <https://github.com/apache/iceberg/issues/2308> >>>>>>> 2. #2783 Metadata Table Empty Projection - Unknown type for int >>>>>>> field. Type name: java.lang.string >>>>>>> <https://github.com/apache/iceberg/issues/2783> >>>>>>> 3. #2284 Core: reassign the partition field IDs and reuse any >>>>>>> existing ID <https://github.com/apache/iceberg/pull/2284>s >>>>>>> >>>>>>> #2284 is in review. >>>>>>> >>>>>>> Ryan said he would take a look at #2308. >>>>>>> >>>>>>> @Szehon Ho <sze...@cloudera.com>, can you please confirm whether or >>>>>>> not you're working on #2783? >>>>>>> >>>>>>> Thanks. >>>>>>> >>>>>>> - Carl >>>>>>> >>>>>>> >>>>>>> >>>>>>> On Mon, Jul 19, 2021 at 12:31 PM Jack Ye <yezhao...@gmail.com> >>>>>>> wrote: >>>>>>> >>>>>>>> I haven't heard any news for the 0.12.0 release since then, are we >>>>>>>> still planning for the release? >>>>>>>> >>>>>>>> Please let me know if there is anything we can do to help speed up >>>>>>>> the process. (I just saw the release board, will try to at least review >>>>>>>> those PRs) >>>>>>>> >>>>>>>> Best, >>>>>>>> Jack Ye >>>>>>>> >>>>>>>> On Mon, Jul 12, 2021 at 5:41 PM Sreeram Garlapati < >>>>>>>> gsreeramku...@gmail.com> wrote: >>>>>>>> >>>>>>>>> Great, thanks Ryan. >>>>>>>>> >>>>>>>>> On Mon, Jul 12, 2021 at 5:17 PM Ryan Blue <b...@tabular.io> wrote: >>>>>>>>> >>>>>>>>>> Sreeram, I was just waiting for tests to pass on that PR. I just >>>>>>>>>> merged it. >>>>>>>>>> >>>>>>>>>> On Mon, Jul 12, 2021 at 4:41 PM Sreeram Garlapati < >>>>>>>>>> gsreeramku...@gmail.com> wrote: >>>>>>>>>> >>>>>>>>>>> Hi Carl, >>>>>>>>>>> >>>>>>>>>>> Thanks a lot for managing 0.12.0 release. >>>>>>>>>>> >>>>>>>>>>> Can you also pl. add this PR: >>>>>>>>>>> https://github.com/apache/iceberg/pull/2752 - which adds the >>>>>>>>>>> option "streaming-skip-delete-snapshots" - to Spark3 >>>>>>>>>>> micro_batch reader. Without this, streaming reads will fail if a >>>>>>>>>>> snapshot >>>>>>>>>>> of type delete or replace is encountered, & is pretty much >>>>>>>>>>> unusable. This >>>>>>>>>>> PR is already approved by multiple Committers - Ryan and Russell. >>>>>>>>>>> >>>>>>>>>>> PS: I am unsure if new PRs will be merged apart from the list >>>>>>>>>>> proposed on the project board - into the *0.12.0* release, and >>>>>>>>>>> hence, proposing this. If this PR will be merged - no action is >>>>>>>>>>> needed. pl. >>>>>>>>>>> pardon my ignorance. >>>>>>>>>>> >>>>>>>>>>> Best regards, >>>>>>>>>>> Sreeram >>>>>>>>>>> >>>>>>>>>>> On Mon, Jul 12, 2021 at 4:14 PM Carl Steinbach <c...@tabular.io> >>>>>>>>>>> wrote: >>>>>>>>>>> >>>>>>>>>>>> Hi Grant, >>>>>>>>>>>> >>>>>>>>>>>> Good catch! I added PR-1648 >>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> to the 0.12.0 >>>>>>>>>>>> project board. >>>>>>>>>>>> >>>>>>>>>>>> - Carl >>>>>>>>>>>> >>>>>>>>>>>> On Mon, Jul 12, 2021 at 1:16 PM Grant Nicholas < >>>>>>>>>>>> gr...@spothero.com> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Howdy! Any updates on PR-1648 >>>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> which upgrades >>>>>>>>>>>>> the avro version used in iceberg? I do not see it in the "To-Do" >>>>>>>>>>>>> section >>>>>>>>>>>>> linked above, but the older avro version has caused major problems >>>>>>>>>>>>> described in this issue and it would be nice to get in 0.12.0. >>>>>>>>>>>>> https://github.com/apache/iceberg/issues/1654 >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> On Mon, Jul 12, 2021 at 2:39 PM Carl Steinbach <c...@apache.org> >>>>>>>>>>>>> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Hi Everyone, >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> I volunteered to be the release manager for the 0.12.0 >>>>>>>>>>>>>> release. My goal is to start cutting release candidates this >>>>>>>>>>>>>> Friday, 7/17 >>>>>>>>>>>>>> at 24:00 PST. I am tracking progress on this release on the >>>>>>>>>>>>>> Release >>>>>>>>>>>>>> 0.12.0 Project Board >>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1>. Note that >>>>>>>>>>>>>> this board only tracks issues that BLOCK the release. >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> There are currently 7 PRs listed in the To-Do >>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1#column-14786627> >>>>>>>>>>>>>> column. I am going to remove these PRs from the 0.12.0 release >>>>>>>>>>>>>> tomorrow, >>>>>>>>>>>>>> 7/13 at 24:00 PST, unless they are updated with the following >>>>>>>>>>>>>> information: >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> 1) Why does the PR need to be included in the 0.12.0 release? >>>>>>>>>>>>>> >>>>>>>>>>>>>> 2) When will the PR will be ready for review? >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> If you have any questions or concerns, please get in touch >>>>>>>>>>>>>> with me over email or slack. >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> Thanks. >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> - Carl >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> -- >>>>>>>>>>>>> >>>>>>>>>>>>> [image: SpotHero] <http://spothero.com/> >>>>>>>>>>>>> >>>>>>>>>>>>> Grant Nicholas / Senior Data Engineer II >>>>>>>>>>>>> Pronouns <https://lgbt.ucsf.edu/pronounsmatter>: he/his >>>>>>>>>>>>> gr...@spothero.com >>>>>>>>>>>>> spothero.com <http://www.spothero.com/> | LinkedIn >>>>>>>>>>>>> <https://www.linkedin.com/in/grantanicholas> >>>>>>>>>>>>> *Your perfect spot is waiting for you! Learn more >>>>>>>>>>>>> at spothero.com/careers <http://spothero.com/careers>* >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> Ryan Blue >>>>>>>>>> Tabular >>>>>>>>>> >>>>>>>>> >>> >>> -- >>> Ryan Blue >>> Tabular >>> >> -- Ryan Blue Tabular
