By the way, Flink has been updated to Flink 1.4.0 as well (as the artifacts already used Scala 2.11).

Regards
JB

On 12/18/2017 11:50 AM, Jean-Baptiste Onofré wrote:
Hi all,

We are pleased to announce that Spark 2.x support in Spark runner has been merged this morning. It supports Spark 2.2.1.

In the same PR, we did update to Scala 2.11, including Flink artifacts update to 2.11 (it means it's already ready to upgrade to Flink 1.4 !).

It also means, as planned, that Spark 2.x support will be included in next Beam 2.3.0 release.

Now, we are going to work on improvements in the Spark runner.

If you have any issue with the Spark runner, please let us know.

Thanks !
Regards
JB

--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com

Reply via email to