Thank you everyone for the examples! Looking forward to see the updated
documents as well!
Best,
Ke
> On Nov 12, 2020, at 1:17 PM, Chamikara Jayalath wrote:
>
> Seems like a good place to promote this PR that adds documentation for
> cross-language transforms :)
> https://github.com/apache/be
Seems like a good place to promote this PR that adds documentation for
cross-language transforms :)
https://github.com/apache/beam/pull/13317
This covers the following for both Java and Python SDKs.
* Creating new cross-language transforms - primary audience will be
transform authors who wish to m
I was not aware of these examples Brian, thanks for sharing. Maybe we should
make these examples more discoverable on the website or as part of Beam's
programming guide.
It would be nice to have an example of the opposite too, calling a Python
transform from Java.
Additionally Java users who want
Hi Ke,
A cross-language pipeline looks a lot like a pipeline written natively in
one of the Beam SDKs, the difference is that some of the transforms in the
pipeline may be "external transforms" that actually have implementations in
a different language. There are a few examples in the beam repo th
I was taking KafkaIO as an example of x-lang when I was doing something
related:
- python transform:
https://github.com/apache/beam/blob/e1fdb9884898a673285b3b932fa99ae019b9c7b5/sdks/python/apache_beam/io/kafka.py#L110
- java transform:
https://github.com/apache/beam/blob/master/sdks
