Hello beamers - Wondering if there is work done already in abstracting the job/pipeline monitoring via sparkrunner. I don't find any documentation beyond a brief wording into this here ( https://beam.apache.org/documentation/runners/spark/#monitoring-your-job). I have looked into apache livy REST server but wanted to get your thoughts before experimenting further. Let me know. Thank you.
Regards, Mahesh *--* *Mahesh Vangala* *(Ph) 443-326-1957* *(web) mvangala.com <http://mvangala.com>*