Re: Current progress on Portable runners

2018-05-22 Thread Eugene Kirpichov
Thanks all! Yeah, I'll update the Portability page with the status of this project and other pointers this week or next (mostly out of office this week). On Fri, May 18, 2018 at 5:01 PM Thomas Weise wrote: > - Flink JobService: in review > > That's TODO

Re: Current progress on Portable runners

2018-05-18 Thread Thomas Weise
- Flink JobService: in review That's TODO (above PR was merged, but it doesn't contain the Flink job service). Discussion about it is here: https://docs.google.com/document/d/1xOaEEJrMmiSHprd-WiYABegfT129qqF-idUBINjxz8s/edit?ts=5afa1238 Thanks, Thomas

Re: Current progress on Portable runners

2018-05-18 Thread Thomas Weise
Most of it should probably go to https://beam.apache.org/con tribute/portability/ Also for reference, here is the prototype doc: https://s.apache.org/beam- portability-team-doc Thomas On Fri, May 18, 2018 at 5:35 AM, Kenneth Knowles wrote: > This is awesome. Would you be up for adding a brief

Re: Current progress on Portable runners

2018-05-18 Thread Kenneth Knowles
This is awesome. Would you be up for adding a brief description at https://beam.apache.org/contribute/#works-in-progress and maybe a pointer to a gdoc with something like the contents of this email? (my reasoning is (a) keep the contribution guide concise but (b) all this detail is helpful yet (c)

Re: Current progress on Portable runners

2018-05-17 Thread Robert Bradshaw
On Thu, May 17, 2018 at 10:25 PM Thomas Weise wrote: > Hi Eugene, > Thanks for putting this together, this is a very nice update and brings > much needed visibility to those hoping to make use of the portability > features or contribute to them. +1, this is a great summary. > Since the P1 (MVP

Re: Current progress on Portable runners

2018-05-17 Thread Thomas Weise
Hi Eugene, Thanks for putting this together, this is a very nice update and brings much needed visibility to those hoping to make use of the portability features or contribute to them. Since the P1 (MVP) milestone is "wordcount" and some of the next things listed are more contributor oriented, pe

Current progress on Portable runners

2018-05-17 Thread Eugene Kirpichov
Hi all, A little over a month ago, a large group of Beam community members has been working a prototype of a portable Flink runner - that is, a runner that can execute Beam pipelines on Flink via the Portability API . The prototype was developed in a separate