Re: [INFO] Spark runner updated to Spark 2.2.1

2017-12-18 Thread Kenneth Knowles
Sweet!

On Mon, Dec 18, 2017 at 9:20 AM, Reuven Lax  wrote:

> Very nice!
>
> On Mon, Dec 18, 2017 at 2:50 AM, Jean-Baptiste Onofré 
> wrote:
>
>> Hi all,
>>
>> We are pleased to announce that Spark 2.x support in Spark runner has
>> been merged this morning. It supports Spark 2.2.1.
>>
>> In the same PR, we did update to Scala 2.11, including Flink artifacts
>> update to 2.11 (it means it's already ready to upgrade to Flink 1.4 !).
>>
>> It also means, as planned, that Spark 2.x support will be included in
>> next Beam 2.3.0 release.
>>
>> Now, we are going to work on improvements in the Spark runner.
>>
>> If you have any issue with the Spark runner, please let us know.
>>
>> Thanks !
>> Regards
>> JB
>> --
>> Jean-Baptiste Onofré
>> jbono...@apache.org
>> http://blog.nanthrax.net
>> Talend - http://www.talend.com
>>
>
>


Re: [INFO] Spark runner updated to Spark 2.2.1

2017-12-18 Thread Reuven Lax
Very nice!

On Mon, Dec 18, 2017 at 2:50 AM, Jean-Baptiste Onofré 
wrote:

> Hi all,
>
> We are pleased to announce that Spark 2.x support in Spark runner has been
> merged this morning. It supports Spark 2.2.1.
>
> In the same PR, we did update to Scala 2.11, including Flink artifacts
> update to 2.11 (it means it's already ready to upgrade to Flink 1.4 !).
>
> It also means, as planned, that Spark 2.x support will be included in next
> Beam 2.3.0 release.
>
> Now, we are going to work on improvements in the Spark runner.
>
> If you have any issue with the Spark runner, please let us know.
>
> Thanks !
> Regards
> JB
> --
> Jean-Baptiste Onofré
> jbono...@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>


Re: [INFO] Spark runner updated to Spark 2.2.1

2017-12-18 Thread Romain Manni-Bucau
Congrats, was waited for a long time! Very impatient to see the
announcement of the 2.3!


Romain Manni-Bucau
@rmannibucau  |  Blog
 | Old Blog
 | Github  |
LinkedIn 

2017-12-18 16:55 GMT+01:00 Jean-Baptiste Onofré :

> By the way, Flink has been updated to Flink 1.4.0 as well (as the
> artifacts already used Scala 2.11).
>
> Regards
> JB
>
> On 12/18/2017 11:50 AM, Jean-Baptiste Onofré wrote:
>
>> Hi all,
>>
>> We are pleased to announce that Spark 2.x support in Spark runner has
>> been merged this morning. It supports Spark 2.2.1.
>>
>> In the same PR, we did update to Scala 2.11, including Flink artifacts
>> update to 2.11 (it means it's already ready to upgrade to Flink 1.4 !).
>>
>> It also means, as planned, that Spark 2.x support will be included in
>> next Beam 2.3.0 release.
>>
>> Now, we are going to work on improvements in the Spark runner.
>>
>> If you have any issue with the Spark runner, please let us know.
>>
>> Thanks !
>> Regards
>> JB
>>
>
> --
> Jean-Baptiste Onofré
> jbono...@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>


Re: [INFO] Spark runner updated to Spark 2.2.1

2017-12-18 Thread Jean-Baptiste Onofré
By the way, Flink has been updated to Flink 1.4.0 as well (as the artifacts 
already used Scala 2.11).


Regards
JB

On 12/18/2017 11:50 AM, Jean-Baptiste Onofré wrote:

Hi all,

We are pleased to announce that Spark 2.x support in Spark runner has been 
merged this morning. It supports Spark 2.2.1.


In the same PR, we did update to Scala 2.11, including Flink artifacts update to 
2.11 (it means it's already ready to upgrade to Flink 1.4 !).


It also means, as planned, that Spark 2.x support will be included in next Beam 
2.3.0 release.


Now, we are going to work on improvements in the Spark runner.

If you have any issue with the Spark runner, please let us know.

Thanks !
Regards
JB


--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com


Re: [INFO] Spark runner updated to Spark 2.2.1

2017-12-18 Thread Aviem Zur
Nice!

On Mon, Dec 18, 2017 at 12:51 PM Jean-Baptiste Onofré 
wrote:

> Hi all,
>
> We are pleased to announce that Spark 2.x support in Spark runner has been
> merged this morning. It supports Spark 2.2.1.
>
> In the same PR, we did update to Scala 2.11, including Flink artifacts
> update to
> 2.11 (it means it's already ready to upgrade to Flink 1.4 !).
>
> It also means, as planned, that Spark 2.x support will be included in next
> Beam
> 2.3.0 release.
>
> Now, we are going to work on improvements in the Spark runner.
>
> If you have any issue with the Spark runner, please let us know.
>
> Thanks !
> Regards
> JB
> --
> Jean-Baptiste Onofré
> jbono...@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>


[INFO] Spark runner updated to Spark 2.2.1

2017-12-18 Thread Jean-Baptiste Onofré

Hi all,

We are pleased to announce that Spark 2.x support in Spark runner has been 
merged this morning. It supports Spark 2.2.1.


In the same PR, we did update to Scala 2.11, including Flink artifacts update to 
2.11 (it means it's already ready to upgrade to Flink 1.4 !).


It also means, as planned, that Spark 2.x support will be included in next Beam 
2.3.0 release.


Now, we are going to work on improvements in the Spark runner.

If you have any issue with the Spark runner, please let us know.

Thanks !
Regards
JB
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com