Hi,

We're looking into leveraging the cross language pipeline feature in our
Beam pipelines on Samza runner. While the feature seems to work well, the
PTransform expansion as a standalone service isn't very convenient.
Particularly that the Python pipeline needs to specify the address of the
expansion service.

I'm wondering why we couldn't embed the expansion service into runner
itself. I understand the cross language feature wants to be runner
independent, but does it make sense to at least provide the option to allow
runner to use the expansion service as a library and make it transparent to
the portable pipeline?

Thanks,
Hai

Reply via email to