Re: Flink 1.6 Support

2018-10-31 Thread Jins George 
Thanks Max. That would help a lot. Manually creating the build with 1.6 
will work for us in short term with development, but to go to production 
it has to be an official release ( due to some regulations at my company)

Thanks,

Jins

On 10/31/18 3:15 AM, Maximilian Michels wrote:
> Hi Jins,
>
> As Thomas mentioned, the Flink Runner has already been prepared for 
> Flink 1.6, you just have to change the Flink version in the Gradle 
> build file.
>
> Of course this is not convenient because you can't fetch this version 
> via Maven Central. So we're planning to release both versions:
>
> https://issues.apache.org/jira/browse/BEAM-5419
>
> Thanks,
> Max
>
> On 31.10.18 06:28, Jins George wrote:
>> Thank you Thomas.  Idea of providing different build targets  for 
>> runners is great, as it enables users to pick from a list of runner 
>> versions.
>>
>> Thanks
>>
>> Jins George
>>
>> On 10/30/18 12:36 PM, Thomas Weise wrote:
>>> There has not been any decision to move to 1.6.x for the next 
>>> release yet.
>>>
>>> There has been related general discussion about upgrading runners 
>>> recently [1]
>>>
>>> Overall we need to consider the support for newer Flink versions 
>>> that users find (the Flink version in distributions and what users 
>>> typically have in their deployment stacks). These upgrades are not 
>>> automatic/cheap/fast, so there is a balance to strike.
>>>
>>> The good news is that with Beam 2.8.0 you should be able to make a 
>>> build for 1.6.x with just a version number change [2] (Other compile 
>>> differences have been cleaned up.)
>>>
>>> [1] 
>>> https://lists.apache.org/thread.html/0588ed783767991aa36b00b8529bbd29b3a8958ee6e82fca83ac2938@%3Cdev.beam.apache.org%3E
>>> [2] 
>>> https://github.com/apache/beam/blob/v2.8.0/runners/flink/build.gradle#L49
>>>
>>>
>>> On Tue, Oct 30, 2018 at 10:50 AM Lukasz Cwik >> > wrote:
>>>
>>>     +dev 
>>>
>>>     On Tue, Oct 30, 2018 at 10:30 AM Jins George
>>>     mailto:jins.geo...@aeris.net>> wrote:
>>>
>>>     Hi Community,
>>>
>>>     Noticed that the Beam 2.8 release comes with flink 1.5.x
>>>     dependency.
>>>     Are there any plans to upgrade flink to  1.6.x  in next beam
>>>     release. (
>>>     I am looking for the better k8s  support in Flink 1.6)
>>>
>>>     Thanks,
>>>
>>>     Jins George
>>>

Re: Flink 1.6 Support

2018-10-31 Thread Maximilian Michels 

Hi Jins,

As Thomas mentioned, the Flink Runner has already been prepared for 
Flink 1.6, you just have to change the Flink version in the Gradle build 
file.


Of course this is not convenient because you can't fetch this version 
via Maven Central. So we're planning to release both versions:


https://issues.apache.org/jira/browse/BEAM-5419

Thanks,
Max

On 31.10.18 06:28, Jins George wrote:
Thank you Thomas.  Idea of providing different build targets  for 
runners is great, as it enables users to pick from a list of runner 
versions.


Thanks

Jins George

On 10/30/18 12:36 PM, Thomas Weise wrote:
There has not been any decision to move to 1.6.x for the next release 
yet.


There has been related general discussion about upgrading runners 
recently [1]


Overall we need to consider the support for newer Flink versions that 
users find (the Flink version in distributions and what users 
typically have in their deployment stacks). These upgrades are not 
automatic/cheap/fast, so there is a balance to strike.


The good news is that with Beam 2.8.0 you should be able to make a 
build for 1.6.x with just a version number change [2]  (Other compile 
differences have been cleaned up.)


[1] 
https://lists.apache.org/thread.html/0588ed783767991aa36b00b8529bbd29b3a8958ee6e82fca83ac2938@%3Cdev.beam.apache.org%3E
[2] 
https://github.com/apache/beam/blob/v2.8.0/runners/flink/build.gradle#L49



On Tue, Oct 30, 2018 at 10:50 AM Lukasz Cwik > wrote:


+dev 

On Tue, Oct 30, 2018 at 10:30 AM Jins George
mailto:jins.geo...@aeris.net>> wrote:

Hi Community,

Noticed that the Beam 2.8 release comes with flink  1.5.x
dependency.
Are there any plans to upgrade flink to  1.6.x  in next beam
release. (
I am looking for the better k8s  support in Flink 1.6)

Thanks,

Jins George

Re: Flink 1.6 Support

2018-10-30 Thread Jins George 
Thank you Thomas.  Idea of providing different build targets  for runners is 
great, as it enables users to pick from a list of runner versions.

Thanks

Jins George

On 10/30/18 12:36 PM, Thomas Weise wrote:
There has not been any decision to move to 1.6.x for the next release yet.

There has been related general discussion about upgrading runners recently [1]

Overall we need to consider the support for newer Flink versions that users 
find (the Flink version in distributions and what users typically have in their 
deployment stacks). These upgrades are not automatic/cheap/fast, so there is a 
balance to strike.

The good news is that with Beam 2.8.0 you should be able to make a build for 
1.6.x with just a version number change [2]  (Other compile differences have 
been cleaned up.)

[1] 
https://lists.apache.org/thread.html/0588ed783767991aa36b00b8529bbd29b3a8958ee6e82fca83ac2938@%3Cdev.beam.apache.org%3E
[2] https://github.com/apache/beam/blob/v2.8.0/runners/flink/build.gradle#L49


On Tue, Oct 30, 2018 at 10:50 AM Lukasz Cwik 
mailto:lc...@google.com>> wrote:
+dev

On Tue, Oct 30, 2018 at 10:30 AM Jins George 
mailto:jins.geo...@aeris.net>> wrote:
Hi Community,

Noticed that the Beam 2.8 release comes with flink  1.5.x dependency.
Are there any plans to upgrade flink to  1.6.x  in next beam release. (
I am looking for the better k8s  support in Flink 1.6)

Thanks,

Jins George

Re: Flink 1.6 Support

2018-10-30 Thread Thomas Weise 
There has not been any decision to move to 1.6.x for the next release yet.

There has been related general discussion about upgrading runners recently
[1]

Overall we need to consider the support for newer Flink versions that users
find (the Flink version in distributions and what users typically have in
their deployment stacks). These upgrades are not automatic/cheap/fast, so
there is a balance to strike.

The good news is that with Beam 2.8.0 you should be able to make a build
for 1.6.x with just a version number change [2]  (Other compile differences
have been cleaned up.)

[1]
https://lists.apache.org/thread.html/0588ed783767991aa36b00b8529bbd29b3a8958ee6e82fca83ac2938@%3Cdev.beam.apache.org%3E
[2]
https://github.com/apache/beam/blob/v2.8.0/runners/flink/build.gradle#L49


On Tue, Oct 30, 2018 at 10:50 AM Lukasz Cwik  wrote:

> +dev 
>
> On Tue, Oct 30, 2018 at 10:30 AM Jins George 
> wrote:
>
>> Hi Community,
>>
>> Noticed that the Beam 2.8 release comes with flink  1.5.x dependency.
>> Are there any plans to upgrade flink to  1.6.x  in next beam release. (
>> I am looking for the better k8s  support in Flink 1.6)
>>
>> Thanks,
>>
>> Jins George
>>
>>

Re: Flink 1.6 Support

2018-10-30 Thread Lukasz Cwik 
+dev 

On Tue, Oct 30, 2018 at 10:30 AM Jins George  wrote:

> Hi Community,
>
> Noticed that the Beam 2.8 release comes with flink  1.5.x dependency.
> Are there any plans to upgrade flink to  1.6.x  in next beam release. (
> I am looking for the better k8s  support in Flink 1.6)
>
> Thanks,
>
> Jins George
>
>