Maybe you can give a look at this?
https://github.com/banzaicloud/spark-metrics
regards
Xinyu Luan wrote:
Can I get any suggestion or some examples for how to get the metrics
correctly.
-
To unsubscribe e-mail:
Hi, I am working on getting elastic search metrics(bytes_sent, bytes_accepted and bytes_retries) whenever we read/write data from elastic search in spark job. We tried to use spark listener, but still did get 0 byte by creating a listener class in the following attachment.package com.moesif.spark
