Re: monitoring for spark standalone

2014-12-11 Thread Otis Gospodnetic
Hi Judy, SPM monitors Spark. Here are some screenshots: http://blog.sematext.com/2014/10/07/apache-spark-monitoring/ Otis -- Monitoring * Alerting * Anomaly Detection * Centralized Log Management Solr Elasticsearch Support * http://sematext.com/ On Mon, Dec 8, 2014 at 2:35 AM, Judy Nash

Re: monitoring for spark standalone

2014-12-08 Thread Akhil Das
You can setup and customize nagios for all these requirements. Or you can use Ganglia if you are not looking for something with alerts (email etc) Thanks Best Regards On Mon, Dec 8, 2014 at 1:05 PM, Judy Nash judyn...@exchange.microsoft.com wrote: Hello, Are there ways we can

monitoring for spark standalone

2014-12-07 Thread Judy Nash
Hello, Are there ways we can programmatically get health status of master slave nodes, similar to Hadoop Ambari? Wiki seems to suggest there are only web UI or instrumentations (http://spark.apache.org/docs/latest/monitoring.html). Thanks, Judy