[Ganglia-general] View ganglia's XML output
As far as I'm aware, ganglia outputs its data as XML that the web page then picks up and processes. What I'm trying to do is write some python that looks at every node in a cluster group and alerts if any of the metrics are over a threshold (easy enough) if I can get hold of ganglia's output. Can anyone point me in this direction please? Regards, Joseph David Borġ http://www.jdborg.com -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general
Re: [Ganglia-general] View ganglia's XML output
You can check check_ganglia_metric written in Python https://github.com/mconigliaro/check_ganglia_metric for example how you can parse the XML. Alternatively, Ganglia Web 3.3.0+ include Nagios integration which does what you are looking for e.g. Check multiple metrics on a range of hosts defined with a regular expression Use this check to check a single or multiple metrics on a range of hosts defined using a regular expression. This is useful when you want to get a single alert if particular metric is critical across a number of hosts. http://sourceforge.net/apps/trac/ganglia/wiki/ganglia_nagios_integration Vladimir On Thu, 10 May 2012, Joe Borġ wrote: As far as I'm aware, ganglia outputs its data as XML that the web page then picks up and processes. What I'm trying to do is write some python that looks at every node in a cluster group and alerts if any of the metrics are over a threshold (easy enough) if I can get hold of ganglia's output. Can anyone point me in this direction please? Regards, Joseph David Borġ http://www.jdborg.com -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general
Re: [Ganglia-general] View ganglia's XML output
Thanks Vladimir, Can I build this without proxy? The ganglia site is on my exceptions list: urllib2.HTTPError: HTTP Error 407: Proxy Authentication Required ( The ISA Server requires authorization to fulfill the request. Access to the Web Proxy service is denied. ) Regards, Joseph David Borġ http://www.jdborg.com On 10 May 2012 13:28, Vladimir Vuksan vli...@veus.hr wrote: You can check check_ganglia_metric written in Python https://github.com/**mconigliaro/check_ganglia_**metrichttps://github.com/mconigliaro/check_ganglia_metric for example how you can parse the XML. Alternatively, Ganglia Web 3.3.0+ include Nagios integration which does what you are looking for e.g. Check multiple metrics on a range of hosts defined with a regular expression Use this check to check a single or multiple metrics on a range of hosts defined using a regular expression. This is useful when you want to get a single alert if particular metric is critical across a number of hosts. http://sourceforge.net/apps/**trac/ganglia/wiki/ganglia_** nagios_integrationhttp://sourceforge.net/apps/trac/ganglia/wiki/ganglia_nagios_integration Vladimir On Thu, 10 May 2012, Joe Borġ wrote: As far as I'm aware, ganglia outputs its data as XML that the web page then picks up and processes. What I'm trying to do is write some python that looks at every node in a cluster group and alerts if any of the metrics are over a threshold (easy enough) if I can get hold of ganglia's output. Can anyone point me in this direction please? Regards, Joseph David Borġ http://www.jdborg.com -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general
Re: [Ganglia-general] View ganglia's XML output
Greeting Joseph !! You can telnet to gmetad service and it will through out the complete XML output of all the nodes example # telnet 127.0.0.1 8649 Regards, Austin On Thu, May 10, 2012 at 2:26 PM, Joe Borġ m...@jdborg.com wrote: As far as I'm aware, ganglia outputs its data as XML that the web page then picks up and processes. What I'm trying to do is write some python that looks at every node in a cluster group and alerts if any of the metrics are over a threshold (easy enough) if I can get hold of ganglia's output. Can anyone point me in this direction please? Regards, Joseph David Borġ http://www.jdborg.com -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general
Re: [Ganglia-general] View ganglia's XML output
Thanks Austin, That's working but only showing me one cluster, is it a different port for the other clusters? Regards, Joseph David Borġ http://www.jdborg.com On 10 May 2012 13:56, talk2austin talk2aus...@gmail.com wrote: Greeting Joseph !! You can telnet to gmetad service and it will through out the complete XML output of all the nodes example # telnet 127.0.0.1 8649 Regards, Austin On Thu, May 10, 2012 at 2:26 PM, Joe Borġ m...@jdborg.com wrote: As far as I'm aware, ganglia outputs its data as XML that the web page then picks up and processes. What I'm trying to do is write some python that looks at every node in a cluster group and alerts if any of the metrics are over a threshold (easy enough) if I can get hold of ganglia's output. Can anyone point me in this direction please? Regards, Joseph David Borġ http://www.jdborg.com -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general
Re: [Ganglia-general] View ganglia's XML output
On May 10, 2012, at 8:44 AM, Aaron Nichols wrote: If you want to see all clusters in a particular grid you can query gmetad on port 8651. If you have multiple grids (multiple hosts running gmetad for different groups of clusters) you will need to query each of those separately. You will want to keep an eye on how often you query though.. the XML tree can get fairly large. I once made the mistake of advertising the existence of the XML port to users and they went nuts on it, brought the server to its knees. With a default ganglia installation, it's something in the neighborhood of 11 kilobytes per machine. Perhaps more interesting is the interactive port, which allows a script to send a GET style query to gmetad and fetch only the data the user is interested in. Downside being it's not documented terribly well (or it wasn't a couple years ago).. I had to figure out how to use it by digging through the web frontend php scripts. Aaron On Thu, May 10, 2012 at 7:36 AM, Joe Borġ m...@jdborg.com wrote: Thanks Austin, That's working but only showing me one cluster, is it a different port for the other clusters? Regards, Joseph David Borġ http://www.jdborg.com On 10 May 2012 13:56, talk2austin talk2aus...@gmail.com wrote: Greeting Joseph !! You can telnet to gmetad service and it will through out the complete XML output of all the nodes example # telnet 127.0.0.1 8649 Regards, Austin On Thu, May 10, 2012 at 2:26 PM, Joe Borġ m...@jdborg.com wrote: As far as I'm aware, ganglia outputs its data as XML that the web page then picks up and processes. What I'm trying to do is write some python that looks at every node in a cluster group and alerts if any of the metrics are over a threshold (easy enough) if I can get hold of ganglia's output. Can anyone point me in this direction please? Regards, Joseph David Borġ http://www.jdborg.com -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ ___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general
Re: [Ganglia-general] View ganglia's XML output
On Thu, May 10, 2012 at 9:05 AM, Seth T Graham set...@fnal.gov wrote: Perhaps more interesting is the interactive port, which allows a script to send a GET style query to gmetad and fetch only the data the user is interested in. Downside being it's not documented terribly well (or it wasn't a couple years ago).. I had to figure out how to use it by digging through the web frontend php scripts. That does sound more interesting - looking around it seems pretty straightforward to get a subset of the xml this way if you know what you are looking for. Would be great to hear from others if there are options for getting a list of what's available without collecting all the data (for example, list of clusters, list of hosts in cluster, etc). -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general
