Thank you all! That means that there's currently no more blocker to start with the Flink 1.14.3 release.
The only thing that's needed is a committer that's willing to follow the release process [1] Any volunteers? Best regards, Martijn [1] https://cwiki.apache.org/confluence/display/FLINK/Creating+a+Flink+Release On Mon, 27 Dec 2021 at 03:17, Qingsheng Ren <renqs...@gmail.com> wrote: > Hi Martjin, > > FLINK-25132 has been merged to master and release-1.14. > > Thanks for your work for releasing 1.14.3! > > Cheers, > > Qingsheng Ren > > > On Dec 26, 2021, at 3:46 PM, Konstantin Knauf <kna...@apache.org> wrote: > > > > Hi Martijn, > > > > FLINK-25375 is merged to release-1.14. > > > > Cheers, > > > > Konstantin > > > > On Wed, Dec 22, 2021 at 12:02 PM David Morávek <d...@apache.org> wrote: > > > >> Hi Martijn, FLINK-25271 has been merged to 1.14 branch. > >> > >> Best, > >> D. > >> > >> On Wed, Dec 22, 2021 at 7:27 AM 任庆盛 <renqs...@gmail.com> wrote: > >> > >>> Hi Martjin, > >>> > >>> Thanks for the effort on Flink 1.14.3. FLINK-25132 has been merged on > >>> master and is waiting for CI on release-1.14. I think it can be closed > >>> today. > >>> > >>> Cheers, > >>> > >>> Qingsheng Ren > >>> > >>>> On Dec 21, 2021, at 6:26 PM, Martijn Visser <mart...@ververica.com> > >>> wrote: > >>>> > >>>> Hi everyone, > >>>> > >>>> I'm restarting this thread [1] with a new subject, given that Flink > >>> 1.14.1 was a (cancelled) emergency release for the Log4j update and > we've > >>> released Flink 1.14.2 as an emergency release for Log4j updates [2]. > >>>> > >>>> To give an update, this is the current blocker for Flink 1.14.3: > >>>> > >>>> * https://issues.apache.org/jira/browse/FLINK-25132 - KafkaSource > >>> cannot work with object-reusing DeserializationSchema -> @ > >>> renqs...@gmail.com can you provide an ETA for this ticket? > >>>> > >>>> There are two critical tickets open for Flink 1.14.3. That means that > >> if > >>> the above ticket is resolved, these two will not block the release. If > we > >>> can merge them in before the above ticket is completed, that's a bonus. > >>>> > >>>> * https://issues.apache.org/jira/browse/FLINK-25199 - fromValues does > >>> not emit final MAX watermark -> @Marios Trivyzas any update or thoughts > >> on > >>> this? > >>>> * https://issues.apache.org/jira/browse/FLINK-25227 - Comparing the > >>> equality of the same (boxed) numeric values returns false -> @Caizhi > Weng > >>> any update or thoughts on this? > >>>> > >>>> Best regards, > >>>> > >>>> Martijn > >>>> > >>>> [1] https://lists.apache.org/thread/r0xhs9x01k8hnm0hyq2kk4ptrhkzgdw9 > >>>> [2] > https://flink.apache.org/news/2021/12/16/log4j-patch-releases.html > >>>> > >>>> On Thu, 9 Dec 2021 at 17:21, David Morávek <d...@apache.org> wrote: > >>>> Hi Martijn, I've just opened a backport PR [1] for FLINK-23946 [2]. > >>>> > >>>> [1] https://github.com/apache/flink/pull/18066 > >>>> [2] https://issues.apache.org/jira/browse/FLINK-23946 > >>>> > >>>> Best, > >>>> D. > >>>> > >>>> On Thu, Dec 9, 2021 at 4:59 PM Fabian Paul <fp...@apache.org> wrote: > >>>> Actually I meant https://issues.apache.org/jira/browse/FLINK-25126 > >>>> sorry for the confusion. > >>>> > >>>> On Thu, Dec 9, 2021 at 4:55 PM Fabian Paul <fp...@apache.org> wrote: > >>>>> > >>>>> Hi Martijn, > >>>>> > >>>>> I just opened the backport for > >>>>> https://issues.apache.org/jira/browse/FLINK-25132. The changes are > >>>>> already approved I only wait for a green Azure build. > >>>>> > >>>>> Best, > >>>>> Fabian > >>>>> > >>>>> On Thu, Dec 9, 2021 at 4:01 PM Martijn Visser <mart...@ververica.com > >>> > >>> wrote: > >>>>>> > >>>>>> Hi all, > >>>>>> > >>>>>> Thanks for the fixes Jingsong and Zhu! > >>>>>> > >>>>>> That means that we still have the following tickets open: > >>>>>> > >>>>>> * https://issues.apache.org/jira/browse/FLINK-23946 - Application > >>> mode > >>>>>> fails fatally when being shut down -> A PR is there, just pending a > >>> review. > >>>>>> * https://issues.apache.org/jira/browse/FLINK-25126 - Kafka > >>> connector tries > >>>>>> to commit aborted transaction in batch mode -> I believe this is > >>> pending a > >>>>>> backport, correct @fp...@apache.org <fp...@apache.org> ? > >>>>>> * https://issues.apache.org/jira/browse/FLINK-25132 - KafkaSource > >>> cannot > >>>>>> work with object-reusing DeserializationSchema -> @ > >>> renqs...@gmail.com > >>>>>> <renqs...@gmail.com> can you provide an ETA for this ticket? > >>>>>> * https://issues.apache.org/jira/browse/FLINK-25199 - fromValues > >>> does not > >>>>>> emit final MAX watermark -> @Marios Trivyzas <mat...@gmail.com> > >> can > >>> you > >>>>>> provide an ETA for this ticket? > >>>>>> * https://issues.apache.org/jira/browse/FLINK-25227 - Comparing > >> the > >>>>>> equality of the same (boxed) numeric values returns false -> > >> @Caizhi > >>> Weng > >>>>>> <tsreape...@gmail.com> mentioned that a fix is planned for > >>> today/tomorrow. > >>>>>> I am wondering if this is indeed a blocker for 1.14.1, but given > >>> that there > >>>>>> are still some blockers waiting to be merged we could probably > >>> include it. > >>>>>> > >>>>>> Best regards, > >>>>>> > >>>>>> Martijn > >>>>>> > >>>>>> On Thu, 9 Dec 2021 at 07:31, Caizhi Weng <tsreape...@gmail.com> > >>> wrote: > >>>>>> > >>>>>>> Hi devs! > >>>>>>> > >>>>>>> Sorry for the interruptions, but I just found an issue [1] (which > >>> I think > >>>>>>> is a blocking one) in every Flink version, including Flink > >> 1.14.1. > >>>>>>> > >>>>>>> For Flink < 1.15, this issue will cause incorrect result when > >> user > >>> cast > >>>>>>> two strings to numerics and compare the numerics. > >>>>>>> > >>>>>>> I'm planning for a quick fix today or tomorrow. > >>>>>>> > >>>>>>> [1] https://issues.apache.org/jira/browse/FLINK-25227 > >>>>>>> > >>>>>>> Zhu Zhu <reed...@gmail.com> 于2021年12月9日周四 10:48写道： > >>>>>>> > >>>>>>>> update: backport of FLINK-19142 is done > >>>>>>>> > >>>>>>>> Thanks, > >>>>>>>> Zhu > >>>>>>>> > >>>>>>>> Zhu Zhu <reed...@gmail.com> 于2021年12月8日周三 19:35写道： > >>>>>>>> > >>>>>>>>> Hi Martijn, > >>>>>>>>> > >>>>>>>>> I'd like to backport the fix of FLINK-19142 to 1.14.1. > >>>>>>>>> The backport is in progress. > >>>>>>>>> Will update it here when it is done. > >>>>>>>>> > >>>>>>>>> Thanks, > >>>>>>>>> Zhu > >>>>>>>>> > >>>>>>>>> Jingsong Li <jingsongl...@gmail.com> 于2021年12月8日周三 10:33写道： > >>>>>>>>> > >>>>>>>>>> Hi Martijn, > >>>>>>>>>> > >>>>>>>>>> We just created a cherry-pick pull-request for > >>>>>>>>>> https://issues.apache.org/jira/browse/FLINK-20370 > >>>>>>>>>> We could finish it as soon as possible. > >>>>>>>>>> > >>>>>>>>>> Best, > >>>>>>>>>> Jingsong > >>>>>>>>>> > >>>>>>>>>> On Fri, Dec 3, 2021 at 10:25 PM Fabian Paul < > >> fp...@apache.org> > >>> wrote: > >>>>>>>>>>> > >>>>>>>>>>> I just opened a PR for > >>>>>>>>>>> https://issues.apache.org/jira/browse/FLINK-25126 I'll > >>> expect to > >>>>>>>> merge > >>>>>>>>>>> it sometime next week. > >>>>>>>>>>> > >>>>>>>>>>> Best, > >>>>>>>>>>> Fabian > >>>>>>>>>>> > >>>>>>>>>>> On Fri, Dec 3, 2021 at 10:49 AM Martijn Visser < > >>>>>>>> mart...@ververica.com> > >>>>>>>>>> wrote: > >>>>>>>>>>>> > >>>>>>>>>>>> Hi all, > >>>>>>>>>>>> > >>>>>>>>>>>> Just a status update on the open blockers for 1.14.1: > >>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-22113 - > >>> UniqueKey > >>>>>>>>>> constraint is lost with multiple sources join in SQL -> I > >>> believe most > >>>>>>>>>> review comments have been fixed and it's just the final > >> review > >>> remarks > >>>>>>>>>> before it's ready. > >>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23946 - > >>> Application > >>>>>>>>>> mode fails fatally when being shut down -> @David Morávek can > >>> you > >>>>>>>> provide > >>>>>>>>>> an update? > >>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-25022 - > >>> ClassLoader > >>>>>>>>>> leak with ThreadLocals on the JM when submitting a job > >> through > >>> the > >>>>>>>> REST API > >>>>>>>>>> -> I think this is just pending on a merge to master and then > >>> creating > >>>>>>>> a > >>>>>>>>>> backport? > >>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-25126 - > >>> Kafka > >>>>>>>>>> connector tries to commit aborted transaction in batch mode > >> -> > >>> This is > >>>>>>>> a > >>>>>>>>>> new blocker. @fp...@apache.org can you give an update? > >>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-25132 - > >>> KafkaSource > >>>>>>>>>> cannot work with object-reusing DeserializationSchema -> > >>> There's a PR > >>>>>>>>>> that's being reviewed and then needs a backport. > >>>>>>>>>>>> > >>>>>>>>>>>> It would be great if we can finish all these blockers > >> next > >>> week to > >>>>>>>>>> start a release. Do the assignees think that's realistic? > >>>>>>>>>>>> > >>>>>>>>>>>> Best regards, > >>>>>>>>>>>> > >>>>>>>>>>>> Martijn > >>>>>>>>>>>> > >>>>>>>>>>>> > >>>>>>>>>>>> > >>>>>>>>>>>> > >>>>>>>>>>>> On Thu, 2 Dec 2021 at 14:25, Marios Trivyzas < > >>> mat...@gmail.com> > >>>>>>>>>> wrote: > >>>>>>>>>>>>> > >>>>>>>>>>>>> https://issues.apache.org/jira/browse/FLINK-22113 will > >>> be merged > >>>>>>>>>> today (most probably) > >>>>>>>>>>>>> > >>>>>>>>>>>>> On Mon, Nov 29, 2021 at 10:15 AM Martijn Visser < > >>>>>>>>>> mart...@ververica.com> wrote: > >>>>>>>>>>>>>> > >>>>>>>>>>>>>> Thanks all for the updates! To summarize, these are > >> open > >>> tickets > >>>>>>>>>> that are considered blockers for Flink 1.14.1: > >>>>>>>>>>>>>> > >>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-22113 - > >>> UniqueKey > >>>>>>>>>> constraint is lost with multiple sources join in SQL -> > >> @Marios > >>>>>>>> Trivyzas > >>>>>>>>>> can you give an estimate when you expect this to be resolved? > >>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23946 - > >>>>>>>> Application > >>>>>>>>>> mode fails fatally when being shut down -> A patch is being > >>> prepared. > >>>>>>>>>> @David Morávek do you have an estimate when this patch will > >> be > >>> there? > >>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24596 - > >>> Bugs in > >>>>>>>>>> sink.buffer-flush before upsert-kafka -> @fp...@apache.org > >> has > >>>>>>>> provided > >>>>>>>>>> a PR is there, so I suspect it would take a couple of days > >>> before this > >>>>>>>> is > >>>>>>>>>> merged. > >>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-25022 - > >>>>>>>> ClassLoader > >>>>>>>>>> leak with ThreadLocals on the JM when submitting a job > >> through > >>> the > >>>>>>>> REST API > >>>>>>>>>> -> @Chesnay Schepler has provided a PR, so I suspect it would > >>> also just > >>>>>>>>>> take a couple of days before this is merged. > >>>>>>>>>>>>>> > >>>>>>>>>>>>>> Is there anyone who can help me with creating the > >> actual > >>> release > >>>>>>>>>> when these tickets are resolved > >>>>>>>>>>>>>> > >>>>>>>>>>>>>> Best regards, > >>>>>>>>>>>>>> > >>>>>>>>>>>>>> Martijn > >>>>>>>>>>>>>> > >>>>>>>>>>>>>> > >>>>>>>>>>>>>> On Fri, 26 Nov 2021 at 12:08, Chesnay Schepler < > >>>>>>>> ches...@apache.org> > >>>>>>>>>> wrote: > >>>>>>>>>>>>>>> > >>>>>>>>>>>>>>> FLINK-25022: I will open a PR later today, and it > >>> should be > >>>>>>>> easy to > >>>>>>>>>>>>>>> backport. > >>>>>>>>>>>>>>> FLINK-25027: Unlikely to make it for 1.14.1; I also > >>> wouldn't > >>>>>>>>>> consider it > >>>>>>>>>>>>>>> a blocker > >>>>>>>>>>>>>>> > >>>>>>>>>>>>>>> On 24/11/2021 19:40, Martijn Visser wrote: > >>>>>>>>>>>>>>>> Hi all, > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> I would like to start a discussion on releasing > >> Flink > >>> 1.14.1. > >>>>>>>>>> Flink 1.14 > >>>>>>>>>>>>>>>> was released on the 29th of September [1] and so far > >>> 107 > >>>>>>>> issues > >>>>>>>>>> have been > >>>>>>>>>>>>>>>> resolved, including multiple blockers and critical > >>> priorities > >>>>>>>>>> [2]. > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> There are currently 169 open tickets which contain a > >>>>>>>> fixVersion > >>>>>>>>>> for 1.14.1 > >>>>>>>>>>>>>>>> [3]. I'm including the ones that are currently > >> marked > >>> as > >>>>>>>>>> critical or a > >>>>>>>>>>>>>>>> blocker to verify if these should be included in > >>> Flink 1.14.1. > >>>>>>>>>> It would be > >>>>>>>>>>>>>>>> great if those that are assigned or working on one > >> or > >>> more of > >>>>>>>>>> these tickets > >>>>>>>>>>>>>>>> can give an update on its status. > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24543 > >> - > >>>>>>>> Zookeeper > >>>>>>>>>> connection > >>>>>>>>>>>>>>>> issue causes inconsistent state in Flink -> I think > >>> this > >>>>>>>> depends > >>>>>>>>>> on the > >>>>>>>>>>>>>>>> outcome of dropping Zookeeper 3.4 as was proposed on > >>> the Dev > >>>>>>>>>> mailing list > >>>>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-25027 > >>> - Allow > >>>>>>>> GC > >>>>>>>>>> of a > >>>>>>>>>>>>>>>> finished job's JobMaster before the slot timeout is > >>> reached > >>>>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-25022 > >> - > >>>>>>>>>> ClassLoader leak with > >>>>>>>>>>>>>>>> ThreadLocals on the JM when submitting a job through > >>> the REST > >>>>>>>> API > >>>>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24789 > >> - > >>>>>>>>>> IllegalStateException > >>>>>>>>>>>>>>>> with CheckpointCleaner being closed already > >>>>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-24328 > >>> - Long > >>>>>>>> term > >>>>>>>>>> fix for > >>>>>>>>>>>>>>>> receiving new buffer size before network reader > >>> configured -> > >>>>>>>>>> I'm not sure > >>>>>>>>>>>>>>>> if this would end up in Flink 1.14.1, I think it's > >>> more likely > >>>>>>>>>> that it > >>>>>>>>>>>>>>>> would be Flink 1.15. Anton/Dawid, could you confirm > >>> this? > >>>>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-23946 > >> - > >>>>>>>>>> Application mode > >>>>>>>>>>>>>>>> fails fatally when being shut down -> This depends > >> on > >>>>>>>>>>>>>>>> https://issues.apache.org/jira/browse/FLINK-24038 > >>> and I don't > >>>>>>>>>> see much > >>>>>>>>>>>>>>>> happening there, so I also expect that this would > >>> move to > >>>>>>>> Flink > >>>>>>>>>> 1.15. > >>>>>>>>>>>>>>>> David, could you confirm? > >>>>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-22113 > >> - > >>>>>>>> UniqueKey > >>>>>>>>>> constraint > >>>>>>>>>>>>>>>> is lost with multiple sources join in SQL > >>>>>>>>>>>>>>>> * https://issues.apache.org/jira/browse/FLINK-21788 > >>> - Throw > >>>>>>>>>>>>>>>> PartitionNotFoundException if the partition file has > >>> been lost > >>>>>>>>>> for blocking > >>>>>>>>>>>>>>>> shuffle -> I'm also expecting that this would move > >> to > >>> Flink > >>>>>>>>>> 1.15, can you > >>>>>>>>>>>>>>>> confirm Yingjie ? > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> There are quite some other tickets that I've > >> excluded > >>> from > >>>>>>>> this > >>>>>>>>>> list, > >>>>>>>>>>>>>>>> because they are either test instabilities or are > >> not > >>>>>>>> depending > >>>>>>>>>> on a Flink > >>>>>>>>>>>>>>>> release to be resolved. > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> Note: there are quite a few test instabilities in > >> the > >>> list and > >>>>>>>>>> help on > >>>>>>>>>>>>>>>> those is always appreciated. You can check all > >>> unassigned > >>>>>>>> tickets > >>>>>>>>>>>>>>>> instabilities in Jira [4]. > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> Are there any other open tickets that we should wait > >>> for? Is > >>>>>>>>>> there a PMC > >>>>>>>>>>>>>>>> member who would like to manage the release? I'm > >> more > >>> than > >>>>>>>> happy > >>>>>>>>>> to help > >>>>>>>>>>>>>>>> with monitoring the status of the tickets. > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> Best regards, > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> Martijn > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> [1] > >>>>>>>> https://flink.apache.org/news/2021/09/29/release-1.14.0.html > >>>>>>>>>>>>>>>> [2] > >>>>>>>>>>>>>>>> > >>>>>>>>>> > >>>>>>>> > >>> > >> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20FLINK%20AND%20status%20in%20(Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%201.14.1%20ORDER%20BY%20priority%20DESC%2C%20created%20DESC > >>>>>>>>>>>>>>>> [3] > >>>>>>>>>>>>>>>> > >>>>>>>>>> > >>>>>>>> > >>> > >> > https://issues.apache.org/jira/issues?jql=project%20%3D%20FLINK%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened)%20AND%20fixVersion%20%3D%201.14.1%20ORDER%20BY%20priority%20DESC%2C%20created%20DESC > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> [4] > >>>>>>>>>>>>>>>> > >>>>>>>>>> > >>>>>>>> > >>> > >> > https://issues.apache.org/jira/issues?jql=project%20%3D%20FLINK%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened)%20AND%20fixVersion%20%3D%201.14.1%20AND%20labels%20%3D%20test-stability%20AND%20assignee%20in%20(EMPTY)%20ORDER%20BY%20priority%20DESC%2C%20created%20DESC > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> Martijn Visser | Product Manager > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> mart...@ververica.com > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> <https://www.ververica.com/> > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> Follow us @VervericaData > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> -- > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> Join Flink Forward <https://flink-forward.org/> - > >>> The Apache > >>>>>>>>>> Flink > >>>>>>>>>>>>>>>> Conference > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> Stream Processing | Event Driven | Real Time > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>> > >>>>>>>>>>>>> > >>>>>>>>>>>>> > >>>>>>>>>>>>> -- > >>>>>>>>>>>>> Marios > >>>>>>>>>> > >>>>>>>>>> > >>>>>>>>>> > >>>>>>>>>> -- > >>>>>>>>>> Best, Jingsong Lee > >>>>>>>>>> > >>>>>>>>> > >>>>>>>> > >>>>>>> > >>> > >>> > >> > > > > > > -- > > > > Konstantin Knauf > > > > https://twitter.com/snntrable > > > > https://github.com/knaufk > >
