Just following up on this thread, I was tracking the 1.3.0 release milestone https://github.com/apache/iceberg/milestone/26 and it seems like we added some more items today. A few of these PRs look pretty close, but I think the main blocker is https://github.com/apache/iceberg/issues/7623 . I think once that’s in we should aim for a 1.3.0 release. If we can let’s discuss this and the logistics in the community sync tomorrow!
Thanks, Amogh Jahagirdar From: Ryan Blue <[email protected]> Reply-To: "[email protected]" <[email protected]> Date: Friday, April 28, 2023 at 11:58 AM To: "[email protected]" <[email protected]> Subject: RE: [EXTERNAL]Java 1.3.0 around mid May? CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe. +1 for a May release! I'm also not sure about consensus for Hadoop. We might want to fix Parquet so that we can upgrade without needing to move Hadoop forward. On Fri, Apr 28, 2023 at 11:43 AM Driesprong, Fokko <[email protected]> wrote: Hey Anton, I think that's a great idea. Would be great to get Spark 3.4 and Flink 1.7 support out. I saw some questions on the Apache Slack today and also noticed that Spark supports timestamps without timezone from Spark 3.4 onward and went ahead and created an issue for that<https://github.com/apache/iceberg/issues/7456>. We might also want to add the Hadoop and Parquet upgrades as a part of this. Do we have a consensus on upgrading Hadoop? Hadoop in Iceberg is still at 2.7.x, Parquet 1.13.0 requires Hadoop 3.x+<https://issues.apache.org/jira/browse/PARQUET-2276>, I've backported support for Hadoop 2.9.x<https://github.com/apache/parquet-mr/pull/1083> which will be part of the patch release 1.13.1. Today at the Parquet sync I volunteered as a release manager to do the patch release. This would also come with running Flink without Hadoop, which would be awesome. I'm all in for doing another release in May, so we can get this in as well. WDYT? Kind regards, Fokko Driesprong Op vr 28 apr 2023 om 19:54 schreef Jack Ye <[email protected]<mailto:[email protected]>>: Looking at the milestone https://github.com/apache/iceberg/milestone/26, most of the PRs are in good progress except for https://github.com/apache/iceberg/issues/7449. Given the fact that many people are looking forward to using Spark 3.4 and Flink 1.17, it's probably worth having a quick release. We might also want to add the Hadoop and Parquet upgrades as a part of this. -Jack On Thu, Apr 27, 2023 at 6:35 PM Anton Okolnychyi <[email protected]> wrote: We briefly discussed the idea of releasing 1.3.0 around mid May during the sync. The primary goal is to support Spark 3.4 and Flink 1.17. There are also a few other notable changes that went in or are very close. Do we see any blockers that we should track? - Anton -- Ryan Blue Tabular
