Any advise/help here is much appreciated.
On Mon, Dec 30, 2019 at 4:16 PM Ninja Coder wrote:
> I have a spark streaming application (currently spark 2.2) which is using
> `org.apache.spark.ui.exec.ExecutorTaskSummary` to grab executor details
> like
> duration, tasks failed, tasks c
I have a spark streaming application (currently spark 2.2) which is using
`org.apache.spark.ui.exec.ExecutorTaskSummary` to grab executor details like
duration, tasks failed, tasks completed, GC time, etc after each batch is
completed. These metrics are then loaded to prometheus and pagerduty alert