Re: Spark Monitoring using Jolokia

Hi, I am totally confused here, may be because I do not exactly understand this, but why is this required? I have always used SPARK UI and found that more than sufficient. And if you know a bit about how SPARK session works then your performance does have a certain degree of predictability as well

Re: Spark Monitoring using Jolokia

And here's some more info on Spark Metrics https://www.slideshare.net/JayeshThakrar/apache-bigdata2017sparkprofiling From: Maximiliano Felice Date: Monday, January 8, 2018 at 8:14 AM To: Irtiza Ali Cc: Subject: Re: Spark Monitoring using Jolokia Hi! I don't know very much about

Re: Spark Monitoring using Jolokia

Hi! I don't know very much about them, but I'm currently working in posting custom metrics into Graphite. I found useful the internals described in this library: https://github.com/groupon/spark-metrics Hope this at least can give you a hint. Best of lu

Spark Monitoring using Jolokia

Hello everyone, I am building a monitoring tool for the spark, for that I needs sparks metrics. I am using jolokia to get the metrics. I have a question that: Can I get all the metrics provided by the spark rest api using the Jolokia? How the spark rest api get the metrics internally? Thanks