Hello, Beam users! Suppose I want to build two (Java) services, one that launches (long-running) dataflow jobs, and the other that monitors the status of dataflow jobs. Within a single service, I could simply track a PipelineResult for each dataflow run and periodically call getState. How can I monitor job status like this from a second, independent service?
I think the answer is to use a DataflowClient in the second service, but creating one requires DataflowPipelineOptions. Are these options supposed to be exactly the same as those used by the first service? Or do only some of the fields have to be the same? Or maybe there's a better alternative than DataflowClient? Thanks in advance! Peter
