Re: 回复:[DISCUSS] Release Flink 1.5.1

2018-07-05 Thread Nico Kruber
I forgot to mention: there are some follow-ups on this but the gravity
is not as high as the deadlock of FLINK-9676 and PRs are not quite ready
yet ...

https://issues.apache.org/jira/browse/FLINK-9755
https://issues.apache.org/jira/browse/FLINK-9756
https://issues.apache.org/jira/browse/FLINK-9761


Nico

On 05/07/18 12:24, Nico Kruber wrote:
> FYI: I just merged this to master as well as release-1.5 (hopefully -
> this is my first merge since I became a committer)
> 
> On 05/07/18 10:22, Zhijiang(wangzhijiang999) wrote:
>> I have reviewed FLINK-9676, wish it merged soon.
>>
>> Zhijiang
>> --
>> 发件人:Chesnay Schepler 
>> 发送时间:2018年7月5日(星期四) 15:58
>> 收件人:dev@flink.apache.org ; wangzhijiang999 
>> ; zjffdu ; Till Rohrmann 
>> 
>> 主 题:Re: [DISCUSS] Release Flink 1.5.1
>>
>> Building the binary releases overnight failed due to a configuration 
>> mistake on my side.
>>
>> Till has informed me that FLINK-9676 might occur more often than we 
>> initially suspected.
>> A PR to address the issue was already opened by Nico.
>> Given that I have to restart the process anyway today I'm delaying the 
>> release for a few hours
>> so we have a chance to get the fix in.
>>
>> On 04.07.2018 11:21, Chesnay Schepler wrote:
>>> Alrighty, looks like we're in agreement for a soon release.
>>>
>>> Let's take inventory of issues to still include:
>>>
>>> - [FLINK-9554] flink scala shell doesn't work in yarn mode
>>> I'm currently taking a look and will probably merge it by the end of 
>>> today.
>>>
>>> - [FLINK-9676] Deadlock during canceling task and recycling exclusive 
>>> buffer
>>> Till is taking a look to gauge how critical/fixable it is; we may not 
>>> fix it in this release.
>>>
>>> - [FLINK-9707] LocalFileSystem does not support concurrent directory 
>>> creations
>>> Till opened a PR that I'm reviewing at the moment.
>>>
>>> - [FLINK-9693] Set Execution#taskRestore to null after deployment
>>> Till opened a PR, i guess i can take a look unless anyone else wants to.
>>>
>>> I will cut the release-branch this evening; this should be enough time 
>>> to fix the above issues. (except maybe FLINK-9676 of course)
>>>
>>> On 02.07.2018 12:19, Chesnay Schepler wrote:
 Hello,

 it has been a little over a month since we've release 1.5.0. Since 
 then we've addressed 56 JIRAs [1] for the 1.5 branch, including 
 stability enhancement to the new execution mode (FLIP-6), fixes for 
 critical issues in the metric system, but also features that didn't 
 quite make it into 1.5.0 like FLIP-6 support for the scala-shell.

 I think now is a good time to start thinking about a 1.5.1 release, 
 for which I would volunteer as the release manager.

 There are a few issues that I'm aware of that we should include in 
 the release [3], but I believe these should be resolved within the 
 next days.
 So that we don't overlap with with proposed 1.6 release [2] we 
 ideally start the release process this week.

 What do you think?

 [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053

 [2] 
 https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E

 [3]

 - https://issues.apache.org/jira/browse/FLINK-9280
 - https://issues.apache.org/jira/browse/FLINK-8785
 - https://issues.apache.org/jira/browse/FLINK-9567

>>>
>>>
>>
> 

-- 
Nico Kruber | Software Engineer
data Artisans

Follow us @dataArtisans
--
Join Flink Forward - The Apache Flink Conference
Stream Processing | Event Driven | Real Time
--
Data Artisans GmbH | Stresemannstr. 121A,10963 Berlin, Germany
data Artisans, Inc. | 1161 Mission Street, San Francisco, CA-94103, USA
--
Data Artisans GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Dr. Kostas Tzoumas, Dr. Stephan Ewen



signature.asc
Description: OpenPGP digital signature


Re: 回复:[DISCUSS] Release Flink 1.5.1

2018-07-05 Thread Chesnay Schepler

Alright then, I'll start building the artifacts.

On 05.07.2018 12:24, Nico Kruber wrote:

FYI: I just merged this to master as well as release-1.5 (hopefully -
this is my first merge since I became a committer)

On 05/07/18 10:22, Zhijiang(wangzhijiang999) wrote:

I have reviewed FLINK-9676, wish it merged soon.

Zhijiang
--
发件人:Chesnay Schepler 
发送时间:2018年7月5日(星期四) 15:58
收件人:dev@flink.apache.org ; wangzhijiang999 
; zjffdu ; Till Rohrmann 

主 题:Re: [DISCUSS] Release Flink 1.5.1

Building the binary releases overnight failed due to a configuration
mistake on my side.

Till has informed me that FLINK-9676 might occur more often than we
initially suspected.
A PR to address the issue was already opened by Nico.
Given that I have to restart the process anyway today I'm delaying the
release for a few hours
so we have a chance to get the fix in.

On 04.07.2018 11:21, Chesnay Schepler wrote:

Alrighty, looks like we're in agreement for a soon release.

Let's take inventory of issues to still include:

- [FLINK-9554] flink scala shell doesn't work in yarn mode
I'm currently taking a look and will probably merge it by the end of
today.

- [FLINK-9676] Deadlock during canceling task and recycling exclusive
buffer
Till is taking a look to gauge how critical/fixable it is; we may not
fix it in this release.

- [FLINK-9707] LocalFileSystem does not support concurrent directory
creations
Till opened a PR that I'm reviewing at the moment.

- [FLINK-9693] Set Execution#taskRestore to null after deployment
Till opened a PR, i guess i can take a look unless anyone else wants to.

I will cut the release-branch this evening; this should be enough time
to fix the above issues. (except maybe FLINK-9676 of course)

On 02.07.2018 12:19, Chesnay Schepler wrote:

Hello,

it has been a little over a month since we've release 1.5.0. Since
then we've addressed 56 JIRAs [1] for the 1.5 branch, including
stability enhancement to the new execution mode (FLIP-6), fixes for
critical issues in the metric system, but also features that didn't
quite make it into 1.5.0 like FLIP-6 support for the scala-shell.

I think now is a good time to start thinking about a 1.5.1 release,
for which I would volunteer as the release manager.

There are a few issues that I'm aware of that we should include in
the release [3], but I believe these should be resolved within the
next days.
So that we don't overlap with with proposed 1.6 release [2] we
ideally start the release process this week.

What do you think?

[1] https://issues.apache.org/jira/projects/FLINK/versions/12343053

[2]
https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E

[3]

- https://issues.apache.org/jira/browse/FLINK-9280
- https://issues.apache.org/jira/browse/FLINK-8785
- https://issues.apache.org/jira/browse/FLINK-9567







Re: 回复:[DISCUSS] Release Flink 1.5.1

2018-07-05 Thread Nico Kruber
FYI: I just merged this to master as well as release-1.5 (hopefully -
this is my first merge since I became a committer)

On 05/07/18 10:22, Zhijiang(wangzhijiang999) wrote:
> I have reviewed FLINK-9676, wish it merged soon.
> 
> Zhijiang
> --
> 发件人:Chesnay Schepler 
> 发送时间:2018年7月5日(星期四) 15:58
> 收件人:dev@flink.apache.org ; wangzhijiang999 
> ; zjffdu ; Till Rohrmann 
> 
> 主 题:Re: [DISCUSS] Release Flink 1.5.1
> 
> Building the binary releases overnight failed due to a configuration 
> mistake on my side.
> 
> Till has informed me that FLINK-9676 might occur more often than we 
> initially suspected.
> A PR to address the issue was already opened by Nico.
> Given that I have to restart the process anyway today I'm delaying the 
> release for a few hours
> so we have a chance to get the fix in.
> 
> On 04.07.2018 11:21, Chesnay Schepler wrote:
>> Alrighty, looks like we're in agreement for a soon release.
>>
>> Let's take inventory of issues to still include:
>>
>> - [FLINK-9554] flink scala shell doesn't work in yarn mode
>> I'm currently taking a look and will probably merge it by the end of 
>> today.
>>
>> - [FLINK-9676] Deadlock during canceling task and recycling exclusive 
>> buffer
>> Till is taking a look to gauge how critical/fixable it is; we may not 
>> fix it in this release.
>>
>> - [FLINK-9707] LocalFileSystem does not support concurrent directory 
>> creations
>> Till opened a PR that I'm reviewing at the moment.
>>
>> - [FLINK-9693] Set Execution#taskRestore to null after deployment
>> Till opened a PR, i guess i can take a look unless anyone else wants to.
>>
>> I will cut the release-branch this evening; this should be enough time 
>> to fix the above issues. (except maybe FLINK-9676 of course)
>>
>> On 02.07.2018 12:19, Chesnay Schepler wrote:
>>> Hello,
>>>
>>> it has been a little over a month since we've release 1.5.0. Since 
>>> then we've addressed 56 JIRAs [1] for the 1.5 branch, including 
>>> stability enhancement to the new execution mode (FLIP-6), fixes for 
>>> critical issues in the metric system, but also features that didn't 
>>> quite make it into 1.5.0 like FLIP-6 support for the scala-shell.
>>>
>>> I think now is a good time to start thinking about a 1.5.1 release, 
>>> for which I would volunteer as the release manager.
>>>
>>> There are a few issues that I'm aware of that we should include in 
>>> the release [3], but I believe these should be resolved within the 
>>> next days.
>>> So that we don't overlap with with proposed 1.6 release [2] we 
>>> ideally start the release process this week.
>>>
>>> What do you think?
>>>
>>> [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053
>>>
>>> [2] 
>>> https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E
>>>
>>> [3]
>>>
>>> - https://issues.apache.org/jira/browse/FLINK-9280
>>> - https://issues.apache.org/jira/browse/FLINK-8785
>>> - https://issues.apache.org/jira/browse/FLINK-9567
>>>
>>
>>
> 

-- 
Nico Kruber | Software Engineer
data Artisans

Follow us @dataArtisans
--
Join Flink Forward - The Apache Flink Conference
Stream Processing | Event Driven | Real Time
--
Data Artisans GmbH | Stresemannstr. 121A,10963 Berlin, Germany
data Artisans, Inc. | 1161 Mission Street, San Francisco, CA-94103, USA
--
Data Artisans GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Dr. Kostas Tzoumas, Dr. Stephan Ewen



signature.asc
Description: OpenPGP digital signature


回复:[DISCUSS] Release Flink 1.5.1

2018-07-05 Thread Zhijiang(wangzhijiang999)
I have reviewed FLINK-9676, wish it merged soon.

Zhijiang
--
发件人:Chesnay Schepler 
发送时间:2018年7月5日(星期四) 15:58
收件人:dev@flink.apache.org ; wangzhijiang999 
; zjffdu ; Till Rohrmann 

主 题:Re: [DISCUSS] Release Flink 1.5.1

Building the binary releases overnight failed due to a configuration 
mistake on my side.

Till has informed me that FLINK-9676 might occur more often than we 
initially suspected.
A PR to address the issue was already opened by Nico.
Given that I have to restart the process anyway today I'm delaying the 
release for a few hours
so we have a chance to get the fix in.

On 04.07.2018 11:21, Chesnay Schepler wrote:
> Alrighty, looks like we're in agreement for a soon release.
>
> Let's take inventory of issues to still include:
>
> - [FLINK-9554] flink scala shell doesn't work in yarn mode
> I'm currently taking a look and will probably merge it by the end of 
> today.
>
> - [FLINK-9676] Deadlock during canceling task and recycling exclusive 
> buffer
> Till is taking a look to gauge how critical/fixable it is; we may not 
> fix it in this release.
>
> - [FLINK-9707] LocalFileSystem does not support concurrent directory 
> creations
> Till opened a PR that I'm reviewing at the moment.
>
> - [FLINK-9693] Set Execution#taskRestore to null after deployment
> Till opened a PR, i guess i can take a look unless anyone else wants to.
>
> I will cut the release-branch this evening; this should be enough time 
> to fix the above issues. (except maybe FLINK-9676 of course)
>
> On 02.07.2018 12:19, Chesnay Schepler wrote:
>> Hello,
>>
>> it has been a little over a month since we've release 1.5.0. Since 
>> then we've addressed 56 JIRAs [1] for the 1.5 branch, including 
>> stability enhancement to the new execution mode (FLIP-6), fixes for 
>> critical issues in the metric system, but also features that didn't 
>> quite make it into 1.5.0 like FLIP-6 support for the scala-shell.
>>
>> I think now is a good time to start thinking about a 1.5.1 release, 
>> for which I would volunteer as the release manager.
>>
>> There are a few issues that I'm aware of that we should include in 
>> the release [3], but I believe these should be resolved within the 
>> next days.
>> So that we don't overlap with with proposed 1.6 release [2] we 
>> ideally start the release process this week.
>>
>> What do you think?
>>
>> [1] https://issues.apache.org/jira/projects/FLINK/versions/12343053
>>
>> [2] 
>> https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E
>>
>> [3]
>>
>> - https://issues.apache.org/jira/browse/FLINK-9280
>> - https://issues.apache.org/jira/browse/FLINK-8785
>> - https://issues.apache.org/jira/browse/FLINK-9567
>>
>
>



回复:[DISCUSS] Release Flink 1.5.1

2018-07-02 Thread Zhijiang(wangzhijiang999)
Hi Chesnay,

Agree with your proposal.  I submitted a jira FLINK-9676 related with deadlock 
issue.
I think it needs to be confirmed whether to be covered in this release or later.

Zhijiang
--
发件人:Chesnay Schepler 
发送时间:2018年7月2日(星期一) 18:19
收件人:dev@flink.apache.org 
主 题:[DISCUSS] Release Flink 1.5.1

Hello,

it has been a little over a month since we've release 1.5.0. Since then 
we've addressed 56 JIRAs [1] for the 1.5 branch, including stability 
enhancement to the new execution mode (FLIP-6), fixes for critical 
issues in the metric system, but also features that didn't quite make it 
into 1.5.0 like FLIP-6 support for the scala-shell.

I think now is a good time to start thinking about a 1.5.1 release, for 
which I would volunteer as the release manager.

There are a few issues that I'm aware of that we should include in the 
release [3], but I believe these should be resolved within the next days.
So that we don't overlap with with proposed 1.6 release [2] we ideally 
start the release process this week.

What do you think?

[1] https://issues.apache.org/jira/projects/FLINK/versions/12343053

[2] 
https://lists.apache.org/thread.html/1b8b0e627739d1f01b760fb722a1aeb2e786eec09ddd47b8303faadb@%3Cdev.flink.apache.org%3E

[3]

- https://issues.apache.org/jira/browse/FLINK-9280
- https://issues.apache.org/jira/browse/FLINK-8785
- https://issues.apache.org/jira/browse/FLINK-9567