Re: Monitoring Hadoop Cluster
zabbix does monitoring, archiving and graphing, and alerts. It has a JMX bean monitor system. If Hadoop has these, or you can add them easily, you have a great monitor. Also, check out 'Starfish'. It's a little old, but I got it running and it was really cool. On Thu, May 10, 2012 at 11:24 PM, Manu S manupk...@gmail.com wrote: Thanks a lot Junyong On Fri, May 11, 2012 at 11:15 AM, JunYong Li lij...@gmail.com wrote: Each has its own merits. http://developer.yahoo.com/hadoop/tutorial/module7.html#monitoring 2012/5/11 Manu S manupk...@gmail.com Hi All, Which is the best monitoring tool for Hadoop cluster monitoring? Ganglia or Nagios? Thanks, Manu S -- Regards Junyong -- Lance Norskog goks...@gmail.com
Re: Monitoring Hadoop Cluster
I've helped out linking hadoop to munin using jmx querying in the past, there's a writeup at: http://www.cs.huji.ac.il/wikis/MediaWiki/lawa/index.php/Munin_for_Hadoop Stu On Fri, May 11, 2012 at 02:15:16AM -0700, Lance Norskog wrote: zabbix does monitoring, archiving and graphing, and alerts. It has a JMX bean monitor system. If Hadoop has these, or you can add them easily, you have a great monitor. Also, check out 'Starfish'. It's a little old, but I got it running and it was really cool. On Thu, May 10, 2012 at 11:24 PM, Manu S manupk...@gmail.com wrote: Thanks a lot Junyong On Fri, May 11, 2012 at 11:15 AM, JunYong Li lij...@gmail.com wrote: Each has its own merits. http://developer.yahoo.com/hadoop/tutorial/module7.html#monitoring 2012/5/11 Manu S manupk...@gmail.com Hi All, Which is the best monitoring tool for Hadoop cluster monitoring? Ganglia or Nagios? Thanks, Manu S -- Regards Junyong -- Lance Norskog goks...@gmail.com -- From the prompt of Stu Teasdale Happiness is a hard disk.
Re: Monitoring Hadoop Cluster
Cool :) Thanks for your quick reply. On Fri, May 11, 2012 at 11:07 AM, v v v...@vigith.com wrote: Ganglia won't send alerts, but it is a very good monitoring tool for viewing the metrics (hadoop has support for emitting metrics to ganglia). If you need alerting (eg, dfs namespace 90%) then you will have to use nagios or something similar to it. I would say, you need both. On May 11, 10:31 am, Manu S manupk...@gmail.com wrote: Hi All, Which is the best monitoring tool for Hadoop cluster monitoring? Ganglia or Nagios? Thanks, Manu S
Re: Monitoring Hadoop Cluster
Each has its own merits. http://developer.yahoo.com/hadoop/tutorial/module7.html#monitoring 2012/5/11 Manu S manupk...@gmail.com Hi All, Which is the best monitoring tool for Hadoop cluster monitoring? Ganglia or Nagios? Thanks, Manu S -- Regards Junyong