Re: monitoring for spark standalone

2014-12-11 Thread Otis Gospodnetic 
Hi Judy,

SPM monitors Spark.  Here are some screenshots:
http://blog.sematext.com/2014/10/07/apache-spark-monitoring/

Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr  Elasticsearch Support * http://sematext.com/


On Mon, Dec 8, 2014 at 2:35 AM, Judy Nash judyn...@exchange.microsoft.com
wrote:

  Hello,



 Are there ways we can programmatically get health status of master  slave
 nodes, similar to Hadoop Ambari?



 Wiki seems to suggest there are only web UI or instrumentations (
 http://spark.apache.org/docs/latest/monitoring.html).



 Thanks,
 Judy

Re: monitoring for spark standalone

2014-12-08 Thread Akhil Das 
You can setup and customize nagios for all these requirements. Or you can
use Ganglia if you are not looking for something with alerts (email etc)

Thanks
Best Regards

On Mon, Dec 8, 2014 at 1:05 PM, Judy Nash judyn...@exchange.microsoft.com
wrote:

  Hello,



 Are there ways we can programmatically get health status of master  slave
 nodes, similar to Hadoop Ambari?



 Wiki seems to suggest there are only web UI or instrumentations (
 http://spark.apache.org/docs/latest/monitoring.html).



 Thanks,
 Judy

monitoring for spark standalone

2014-12-07 Thread Judy Nash 
Hello,

Are there ways we can programmatically get health status of master  slave 
nodes, similar to Hadoop Ambari?

Wiki seems to suggest there are only web UI or instrumentations 
(http://spark.apache.org/docs/latest/monitoring.html).

Thanks,
Judy