Hi Tarun, You can use Ganglia for monitoring the entire cluster, and if you want some more custom functionality like sending emails etc, then you can go after nagios.
Thanks Best Regards On Tue, Oct 14, 2014 at 3:31 AM, Tarun Garg <[email protected]> wrote: > Hi All, > > I am doing a POC and written a Job in java. so the architecture has kafka > and spark. > Now i want a process to notify me whenever system performance is getting > down or in crunch of resources, like CPU or RAM. I > understand org.apache.spark.streaming.scheduler.StreamingListener, but it > has very limited functionality. > > Can any one suggest me a way (API) to write a Spark cluster watcher. > > Thanks >
