Hi Luke, that's really great and very promising !
It's really ambitious but I like the idea. Just to clarify: the purpose of using gRPC is once the docker container is running, then we can "interact" with the container to spread and delegate processing to the docker container, correct ? The users/devops have to setup the docker containers as prerequisite. Then, the "location" of the containers (kind of container registry) is set via the pipeline options and used by gRPC ?
Thanks Luke ! Regards JB On 01/19/2017 03:56 PM, Lukasz Cwik wrote:
I have been prototyping several components towards the Beam technical vision of being able to execute an arbitrary language using an arbitrary runner. I would like to share this overview [1] of what I have been working towards. I also share this PR [2] with a proposed API, service definitions and partial implementation. 1: https://s.apache.org/beam-fn-api 2: https://github.com/apache/beam/pull/1801 Please comment on the overview within this thread, and any specific code comments on the PR directly. Luke
-- Jean-Baptiste Onofré [email protected] http://blog.nanthrax.net Talend - http://www.talend.com
