Hi Kanisha,
generally speaking, it depends of the runner. The programming model
doesn't provide runtime "tooling" around that.
So, each runner may deal differently.
For instance, the spark runner uses kind of graceful shutdown using a
timeout for inflight PCollections.
Regards
JB
On 04/25/2016 07:25 PM, kaniska Mandal wrote:
Whats the recommended approach
to reliably shut down the pipeline
to run the beam-flink pipeline in a scheduled manner
tomonitor the rates/throughputs/throttling/multiple threads spawned - by
Pipeline , any suggestion ?
Thanks
Kaniska
--
Jean-Baptiste Onofré
[email protected]
http://blog.nanthrax.net
Talend - http://www.talend.com
