Hi Beam Devs,

I still don't quite understand:

"Apache Beam provides a portable API layer for building sophisticated
data-parallel processing pipelines that may be executed across a diversity
of execution engines, or *runners*."

(from https://beam.apache.org/documentation/runners/capability-matrix/)

And specifically, close reading of:
https://beam.apache.org/contribute/portability/

What if I'd like to implement a runner that is non-JVM?  Though would
leverage the Python and Go SDKs?  Specifically, thinking of:
https://www.wallaroolabs.com (I am out in NY meeting with friends there
later this week, and wanted to get a sense of, feasibility, work involved,
etc -- to propose that we add a new Wallaroo runner).

Is there a way to keep java out of the mix completely and still work with
Beam on a non JVM runner (seems maybe eventually, but what about
currently/near future)?

Any input, thoughts, ideas, other pages or info to explore -- all
appreciated; thanks!
Austin

Reply via email to