Hey JB, Thanks for the update. The Gradle upgrade <https://github.com/apache/iceberg/pull/8486> is in, thanks again for working on that. We also need to update the shadow plugin <https://github.com/apache/iceberg/pull/10568> to get the Parquet 1.14.1 PR <https://github.com/apache/iceberg/pull/10209> in.
Kind regards, Fokko Op di 25 jun 2024 om 17:42 schreef Jean-Baptiste Onofré <j...@nanthrax.net>: > Ah by the way, I also plan to finalize Avro releases to update in iceberg > (especially for both Java and rust). > > I will keep you posted. > > Regards > JB > > Le mar. 25 juin 2024 à 15:47, Jean-Baptiste Onofré <j...@nanthrax.net> a > écrit : > >> Hi folks, >> >> I'm happy to share that we fixed the gradle-revapi with Gradle 8.2+ >> and we did a fork and a new release. >> It means that we will be able to upgrade to Gradle 8.8 for >> iceberg-java 1.6.0 release (see >> https://github.com/apache/iceberg/pull/8486). >> After this merge, we will be able to merge Parquet 1.14.0 upgrade >> (https://github.com/apache/iceberg/pull/10209). >> >> We also need review/merge on the following PRs: >> - I reviewed the Kafka connect commits coordinator PR and it looks >> good to me: https://github.com/apache/iceberg/pull/10351 >> - I reviewed Flink 1.19 run without Hadoop PR >> (https://github.com/apache/iceberg/pull/10209) >> >> I will be able to start the release process when all of these PRs will >> be merged. >> >> Thanks ! >> Regards >> JB >> >> On Thu, Jun 13, 2024 at 8:59 PM Jean-Baptiste Onofré <j...@nanthrax.net> >> wrote: >> > >> > Hi Alex >> > >> > Sure no problem. We can flag the PR to 1.6.0 release. >> > >> > Regards >> > JB >> > >> > Le jeu. 13 juin 2024 à 17:14, Alex Dutra <alex.du...@dremio.com.invalid> >> a écrit : >> >> >> >> Hi JB, >> >> >> >> Thank you for putting up the 1.6 release proposal. >> >> >> >> I also would like to bump the Nessie version to its next release, >> which is due today and should be available in a few hours from now. My >> understanding is that the Renovate bot would immediately pick up the new >> version and automatically create a PR for it, but it doesn't hurt to >> mention it here so that it does not go under our radar. There is no >> breaking change in this release, FYI. >> >> >> >> Regards, >> >> >> >> Alex >> >> >> >> On Wed, Jun 12, 2024 at 4:33 PM Jean-Baptiste Onofré <j...@nanthrax.net> >> wrote: >> >>> >> >>> Hi Fokko >> >>> >> >>> Thanks for the feedback. >> >>> >> >>> About Avro, I'm updating my PR about trusted packages, it "has to be" >> >>> included in the next Avro releases. Let me send a message on Avro >> >>> mailing list. >> >>> >> >>> Good point about Flink, let me see if Peter can help there. >> >>> >> >>> Regards >> >>> JB >> >>> >> >>> On Wed, Jun 12, 2024 at 3:44 PM Fokko Driesprong <fo...@apache.org> >> wrote: >> >>> > >> >>> > Hi JB, thanks for raising this. >> >>> > >> >>> >> - With the Gradle version update, we will be able to upgrade to >> Parquet 1.14.0 >> >>> > >> >>> > We might want to defer this until Parquet 1.14.1 gets released. >> There is an issue found with Jackson that prohibits Spark from upgrading to >> 1.14.0. It might be that this is also the case with other query engines. >> Gang already started a DISCUSS thread on running the minor release. >> >>> > >> >>> >> - Depending of the timing, I will include new Avro releases >> >>> > >> >>> > I would love that! With the release it allows us to use the >> BlockingDirectBinaryEncoder, which will allow efficient skipping of lists >> and maps in the file. This will speed up operations like expire snapshots >> quite a bit because we can jump easily over all the statistics. >> >>> > >> >>> > It would be great if there were some Flink reviewers to get some >> eyes on this PR to run Flink without Hadoop. We have to change some APIs >> and with the introduction of Flink 1.19 in Iceberg 1.16.0 this is a great >> moment. >> >>> > >> >>> > Kind regards, >> >>> > Fokko >> >>> > >> >>> > Op ma 10 jun 2024 om 00:24 schreef Jean-Baptiste Onofré < >> j...@nanthrax.net>: >> >>> >> >> >>> >> Hi folks, >> >>> >> >> >>> >> As discussed during the last community meeting, we are heading to >> the >> >>> >> Apache Iceberg 1.6.0 release. >> >>> >> >> >>> >> The Iceberg 1.6.0 milestone is present for both GitHub Issues and >> PRs. >> >>> >> >> >>> >> I'm targeting major updates for this release: >> >>> >> - the Kafka commit coordinator (PR is in review) >> >>> >> - Revapi "fix" to be able to upgrade to latest Gradle version (I >> have >> >>> >> one PR ready and I have another exploring a new option) >> >>> >> - With the Gradle version update, we will be able to upgrade to >> Parquet 1.14.0 >> >>> >> - Depending of the timing, I will include new Avro releases >> >>> >> >> >>> >> Please, if you have anything you want to include in the 1.6.0 >> release, >> >>> >> please let me know and create an issue on GitHub with the "Iceberg >> >>> >> 1.6.0" milestone. >> >>> >> >> >>> >> Thanks ! >> >>> >> >> >>> >> Regards >> >>> >> JB >> >
