All I have to say is wow! I never tried jconsole before. I have
hadoop_trunk checked out and the JMX has all kinds of great
information. I am going to look at how I can get JMX/cacti/and hadoop
working together.
Just as an FYI there are separate ENV variables for each now. If you
override
The simple way would be use use nrpe and check_proc. I have never
tested, but a command like 'ps -ef | grep java | grep NameNode' would
be a fairly decent check. That is not very robust but it should let
you know if the process is alive.
You could also monitor the web interfaces associated with
Hey Edward,
The JMX documentation for Hadoop is non-existent, but here's about
what you need to do:
1) download and install the check_jmx Nagios plugin
2) Open up the hadoop JMX install to the outside world. I added the
following lines to hadoop-env.sh
export HADOOP_OPTS=
Edward Capriolo wrote:
The simple way would be use use nrpe and check_proc. I have never
tested, but a command like 'ps -ef | grep java | grep NameNode' would
be a fairly decent check. That is not very robust but it should let
you know if the process is alive.
You could also monitor the web
That all sounds good. By 'quick hack' I meant 'check_tcp' was not
good enough because an open TCP socket does not prove much. However,
if the page returns useful attributes that show cluster is alive that
is great and easy.
Come to think of it you can navigate the dfshealth page and get useful
try jmx. There should be also jmx to snmp available somewhere.
http://blogs.sun.com/jmxetc/entry/jmx_vs_snmp
~~~
101tec Inc., Menlo Park, California
web: http://www.101tec.com
blog: http://www.find23.net
On Oct 6, 2008, at 10:05 AM, Gerardo Velez wrote:
Hi
Hey Stefan,
Is there any documentation for making JMX working in Hadoop?
Brian
On Oct 7, 2008, at 7:03 PM, Stefan Groschupf wrote:
try jmx. There should be also jmx to snmp available somewhere.
http://blogs.sun.com/jmxetc/entry/jmx_vs_snmp
~~~
101tec Inc., Menlo
Hadoop already integrated jmx inside, you can extend them to
implement what you want to monitor, it need to modify some code to
add some counters or something like that.
One thing you may need to be care is hadoop does not include any
JMXConnectorServer inside, you need to start one
Hi Everyone!
I would like to implement Nagios health monitoring of a Hadoop grid.
Some of you have some experience here, do you hace any approach or advice I
could use.
At this time I've been only playing with jsp's files that hadoop has
integrated into it. so I;m not sure if it could be a
The easiest approach I can think of is to write a simple Nagios plugin that
checks if the datanode JVM process is alive. Or you may
write a Nagios-plugin that checks for error or warning messages in datanode
logs. (I am sure you can find quite a few log-checking Nagios plugin in
nagiosplugin.org)
10 matches
Mail list logo
