Hi Sergio,
DoFn will execute per element (with eventually a hook on StartBundle,
FinishBundle, and Teardown). It's basic the way it works in IO WriteFn:
we create the connection in StartBundle and send each element (with a
batch) to external resource.
PTransform is maybe more flexible in case of interact with "outside"
resources.
Do you have use case to be sure I understand ?
Thanks !
Regards
JB
On 11/22/2016 10:39 AM, Sergio Fernández wrote:
Hi,
I'd like resume the idea to have TensorFlow-based tasks running in a Beam
Pipeline. So far the cleaner approach I can imagine would be to have it
running outside (Functions in GCP, Lambdas in AWS, Microservices generally
speaking).
Therefore, does the current Beam model provide the sense of a DoFn which
actually runs externally?
Thanks in advance for the feedback.
Cheers,
--
Jean-Baptiste Onofré
[email protected]
http://blog.nanthrax.net
Talend - http://www.talend.com
