Re: 回复:[DISCUSS] Release Flink 1.5.1
I forgot to mention: there are some follow-ups on this but the gravity is not as high as the deadlock of FLINK-9676 and PRs are not quite ready yet ... https://issues.apache.org/jira/browse/FLINK-9755 https://issues.apache.org/jira/browse/FLINK-9756 https://issues.apache.org/jira/browse/FLINK-9761 Nico On 05/07/18 12:24, Nico Kruber wrote: > FYI: I just merged this to master as well as release-1.5 (hopefully - > this is my first merge since I became a committer) > > On 05/07/18 10:22, Zhijiang(wangzhijiang999) wrote: >> I have reviewed FLINK-9676, wish it merged soon. >> >> Zhijiang >> -- >> 发件人:Chesnay Schepler >> 发送时间:2018年7月5日(星期四) 15:58 >> 收件人:dev@flink.apache.org ; wangzhijiang999 >> ; zjffdu ; Till Rohrmann >> >> 主 题:Re: [DISCUSS] Release Flink 1.5.1 >> >> Building the binary releases overnight failed due to a configuration >> mistake on my side. >> >> Till has informed me that FLINK-9676 might occur more often than we >> initially suspected. >> A PR to address the issue was already opened by Nico. >> Given that I have to restart the process anyway today I'm delaying the >> release for a few hours >> so we have a chance to get the fix in. >> >> On 04.07.2018 11:21, Chesnay Schepler wrote: >>> Alrighty, looks like we're in agreement for a soon release. >>> >>> Let's take inventory of issues to still include: >>> >>> - [FLINK-9554] flink scala shell doesn't work in yarn mode >>> I'm currently taking a look and will probably merge it by the end of >>> today. >>> >>> - [FLINK-9676] Deadlock during canceling task and recycling exclusive >>> buffer >>> Till is taking a look to gauge how critical/fixable it is; we may not >>> fix it in this release. >>> >>> - [FLINK-9707] LocalFileSystem does not support concurrent directory >>> creations >>> Till opened a PR that I'm reviewing at the moment. >>> >>> - [FLINK-9693] Set Execution#taskRestore to null after deployment >>> Till opened a PR, i guess i can take a look unless anyone else wants to. >>> >>> I will cut the release-branch this evening; this should be enough time >>> to fix the above issues. (except maybe FLINK-9676 of course) >>> >>> On 02.07.2018 12:19, Chesnay Schepler wrote: Hello, it has been a little over a month since we've release 1.5.0. Since then we've addressed 56 JIRAs [1] for the 1.5 branch, including stability enhancement to the new execution mode (FLIP-6), fixes for critical issues in the metric system, but also features that didn't quite make it into 1.5.0 like FLIP-6 support for the scala-shell. I think now is a good time to start thinking about a 1.5.1 release, for which I would volunteer as the release manager. There are a few issues that I'm aware of that we should include in the release [3], but I believe these should be resolved within the next days. So that we don't overlap with with proposed 1.6 release [2] we ideally start the release process this week. What do you think? [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053 [2] https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E [3] - https://issues.apache.org/jira/browse/FLINK-9280 - https://issues.apache.org/jira/browse/FLINK-8785 - https://issues.apache.org/jira/browse/FLINK-9567 >>> >>> >> > -- Nico Kruber | Software Engineer data Artisans Follow us @dataArtisans -- Join Flink Forward - The Apache Flink Conference Stream Processing | Event Driven | Real Time -- Data Artisans GmbH | Stresemannstr. 121A,10963 Berlin, Germany data Artisans, Inc. | 1161 Mission Street, San Francisco, CA-94103, USA -- Data Artisans GmbH Registered at Amtsgericht Charlottenburg: HRB 158244 B Managing Directors: Dr. Kostas Tzoumas, Dr. Stephan Ewen signature.asc Description: OpenPGP digital signature
Re: 回复:[DISCUSS] Release Flink 1.5.1
Alright then, I'll start building the artifacts. On 05.07.2018 12:24, Nico Kruber wrote: FYI: I just merged this to master as well as release-1.5 (hopefully - this is my first merge since I became a committer) On 05/07/18 10:22, Zhijiang(wangzhijiang999) wrote: I have reviewed FLINK-9676, wish it merged soon. Zhijiang -- 发件人:Chesnay Schepler 发送时间:2018年7月5日(星期四) 15:58 收件人:dev@flink.apache.org ; wangzhijiang999 ; zjffdu ; Till Rohrmann 主 题:Re: [DISCUSS] Release Flink 1.5.1 Building the binary releases overnight failed due to a configuration mistake on my side. Till has informed me that FLINK-9676 might occur more often than we initially suspected. A PR to address the issue was already opened by Nico. Given that I have to restart the process anyway today I'm delaying the release for a few hours so we have a chance to get the fix in. On 04.07.2018 11:21, Chesnay Schepler wrote: Alrighty, looks like we're in agreement for a soon release. Let's take inventory of issues to still include: - [FLINK-9554] flink scala shell doesn't work in yarn mode I'm currently taking a look and will probably merge it by the end of today. - [FLINK-9676] Deadlock during canceling task and recycling exclusive buffer Till is taking a look to gauge how critical/fixable it is; we may not fix it in this release. - [FLINK-9707] LocalFileSystem does not support concurrent directory creations Till opened a PR that I'm reviewing at the moment. - [FLINK-9693] Set Execution#taskRestore to null after deployment Till opened a PR, i guess i can take a look unless anyone else wants to. I will cut the release-branch this evening; this should be enough time to fix the above issues. (except maybe FLINK-9676 of course) On 02.07.2018 12:19, Chesnay Schepler wrote: Hello, it has been a little over a month since we've release 1.5.0. Since then we've addressed 56 JIRAs [1] for the 1.5 branch, including stability enhancement to the new execution mode (FLIP-6), fixes for critical issues in the metric system, but also features that didn't quite make it into 1.5.0 like FLIP-6 support for the scala-shell. I think now is a good time to start thinking about a 1.5.1 release, for which I would volunteer as the release manager. There are a few issues that I'm aware of that we should include in the release [3], but I believe these should be resolved within the next days. So that we don't overlap with with proposed 1.6 release [2] we ideally start the release process this week. What do you think? [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053 [2] https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E [3] - https://issues.apache.org/jira/browse/FLINK-9280 - https://issues.apache.org/jira/browse/FLINK-8785 - https://issues.apache.org/jira/browse/FLINK-9567
Re: 回复:[DISCUSS] Release Flink 1.5.1
FYI: I just merged this to master as well as release-1.5 (hopefully - this is my first merge since I became a committer) On 05/07/18 10:22, Zhijiang(wangzhijiang999) wrote: > I have reviewed FLINK-9676, wish it merged soon. > > Zhijiang > -- > 发件人:Chesnay Schepler > 发送时间:2018年7月5日(星期四) 15:58 > 收件人:dev@flink.apache.org ; wangzhijiang999 > ; zjffdu ; Till Rohrmann > > 主 题:Re: [DISCUSS] Release Flink 1.5.1 > > Building the binary releases overnight failed due to a configuration > mistake on my side. > > Till has informed me that FLINK-9676 might occur more often than we > initially suspected. > A PR to address the issue was already opened by Nico. > Given that I have to restart the process anyway today I'm delaying the > release for a few hours > so we have a chance to get the fix in. > > On 04.07.2018 11:21, Chesnay Schepler wrote: >> Alrighty, looks like we're in agreement for a soon release. >> >> Let's take inventory of issues to still include: >> >> - [FLINK-9554] flink scala shell doesn't work in yarn mode >> I'm currently taking a look and will probably merge it by the end of >> today. >> >> - [FLINK-9676] Deadlock during canceling task and recycling exclusive >> buffer >> Till is taking a look to gauge how critical/fixable it is; we may not >> fix it in this release. >> >> - [FLINK-9707] LocalFileSystem does not support concurrent directory >> creations >> Till opened a PR that I'm reviewing at the moment. >> >> - [FLINK-9693] Set Execution#taskRestore to null after deployment >> Till opened a PR, i guess i can take a look unless anyone else wants to. >> >> I will cut the release-branch this evening; this should be enough time >> to fix the above issues. (except maybe FLINK-9676 of course) >> >> On 02.07.2018 12:19, Chesnay Schepler wrote: >>> Hello, >>> >>> it has been a little over a month since we've release 1.5.0. Since >>> then we've addressed 56 JIRAs [1] for the 1.5 branch, including >>> stability enhancement to the new execution mode (FLIP-6), fixes for >>> critical issues in the metric system, but also features that didn't >>> quite make it into 1.5.0 like FLIP-6 support for the scala-shell. >>> >>> I think now is a good time to start thinking about a 1.5.1 release, >>> for which I would volunteer as the release manager. >>> >>> There are a few issues that I'm aware of that we should include in >>> the release [3], but I believe these should be resolved within the >>> next days. >>> So that we don't overlap with with proposed 1.6 release [2] we >>> ideally start the release process this week. >>> >>> What do you think? >>> >>> [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053 >>> >>> [2] >>> https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E >>> >>> [3] >>> >>> - https://issues.apache.org/jira/browse/FLINK-9280 >>> - https://issues.apache.org/jira/browse/FLINK-8785 >>> - https://issues.apache.org/jira/browse/FLINK-9567 >>> >> >> > -- Nico Kruber | Software Engineer data Artisans Follow us @dataArtisans -- Join Flink Forward - The Apache Flink Conference Stream Processing | Event Driven | Real Time -- Data Artisans GmbH | Stresemannstr. 121A,10963 Berlin, Germany data Artisans, Inc. | 1161 Mission Street, San Francisco, CA-94103, USA -- Data Artisans GmbH Registered at Amtsgericht Charlottenburg: HRB 158244 B Managing Directors: Dr. Kostas Tzoumas, Dr. Stephan Ewen signature.asc Description: OpenPGP digital signature
回复:[DISCUSS] Release Flink 1.5.1
I have reviewed FLINK-9676, wish it merged soon. Zhijiang -- 发件人:Chesnay Schepler 发送时间:2018年7月5日(星期四) 15:58 收件人:dev@flink.apache.org ; wangzhijiang999 ; zjffdu ; Till Rohrmann 主 题:Re: [DISCUSS] Release Flink 1.5.1 Building the binary releases overnight failed due to a configuration mistake on my side. Till has informed me that FLINK-9676 might occur more often than we initially suspected. A PR to address the issue was already opened by Nico. Given that I have to restart the process anyway today I'm delaying the release for a few hours so we have a chance to get the fix in. On 04.07.2018 11:21, Chesnay Schepler wrote: > Alrighty, looks like we're in agreement for a soon release. > > Let's take inventory of issues to still include: > > - [FLINK-9554] flink scala shell doesn't work in yarn mode > I'm currently taking a look and will probably merge it by the end of > today. > > - [FLINK-9676] Deadlock during canceling task and recycling exclusive > buffer > Till is taking a look to gauge how critical/fixable it is; we may not > fix it in this release. > > - [FLINK-9707] LocalFileSystem does not support concurrent directory > creations > Till opened a PR that I'm reviewing at the moment. > > - [FLINK-9693] Set Execution#taskRestore to null after deployment > Till opened a PR, i guess i can take a look unless anyone else wants to. > > I will cut the release-branch this evening; this should be enough time > to fix the above issues. (except maybe FLINK-9676 of course) > > On 02.07.2018 12:19, Chesnay Schepler wrote: >> Hello, >> >> it has been a little over a month since we've release 1.5.0. Since >> then we've addressed 56 JIRAs [1] for the 1.5 branch, including >> stability enhancement to the new execution mode (FLIP-6), fixes for >> critical issues in the metric system, but also features that didn't >> quite make it into 1.5.0 like FLIP-6 support for the scala-shell. >> >> I think now is a good time to start thinking about a 1.5.1 release, >> for which I would volunteer as the release manager. >> >> There are a few issues that I'm aware of that we should include in >> the release [3], but I believe these should be resolved within the >> next days. >> So that we don't overlap with with proposed 1.6 release [2] we >> ideally start the release process this week. >> >> What do you think? >> >> [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053 >> >> [2] >> https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E >> >> [3] >> >> - https://issues.apache.org/jira/browse/FLINK-9280 >> - https://issues.apache.org/jira/browse/FLINK-8785 >> - https://issues.apache.org/jira/browse/FLINK-9567 >> > >
回复:[DISCUSS] Release Flink 1.5.1
Hi Chesnay, Agree with your proposal. I submitted a jira FLINK-9676 related with deadlock issue. I think it needs to be confirmed whether to be covered in this release or later. Zhijiang -- 发件人:Chesnay Schepler 发送时间:2018年7月2日(星期一) 18:19 收件人:dev@flink.apache.org 主 题:[DISCUSS] Release Flink 1.5.1 Hello, it has been a little over a month since we've release 1.5.0. Since then we've addressed 56 JIRAs [1] for the 1.5 branch, including stability enhancement to the new execution mode (FLIP-6), fixes for critical issues in the metric system, but also features that didn't quite make it into 1.5.0 like FLIP-6 support for the scala-shell. I think now is a good time to start thinking about a 1.5.1 release, for which I would volunteer as the release manager. There are a few issues that I'm aware of that we should include in the release [3], but I believe these should be resolved within the next days. So that we don't overlap with with proposed 1.6 release [2] we ideally start the release process this week. What do you think? [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053 [2] https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E [3] - https://issues.apache.org/jira/browse/FLINK-9280 - https://issues.apache.org/jira/browse/FLINK-8785 - https://issues.apache.org/jira/browse/FLINK-9567