Re: [Ganglia-developers] dynamic discovery of hosts in EC2
Hi Paul, Thanks for your feedback. That was the best solution I came up with too so I've added this in and it seems to work well. An added side-effect is that the file can also be used to troubleshoot if you need to know exactly where the gmond is sending its metrics too without having to run the agent in debug mode. Regards, Nick On Wed, Oct 10, 2012 at 1:38 PM, Paul Hewlett paul.hewl...@arm.com wrote: ** ** Hi Nick ** ** Modify gmond to write a special file /etc/ganglia/ec2.conf with the discovered instances and then modify gmetric to read that file – using a cmdline option perhaps This change should be lightweight enough for gmetric ** ** Regards ** ** -- Paul Hewlett X25250 http://www.theregister.co.uk/2012/06/25/rbs_natwest_what_went_wrong/ ARM Ltd 110 Fulbourn Road, Cambridge, CB1 9NJ Tel: +44 (0)1223 405923 skype: paul-at-arm www.arm.com ** ** ** ** *From:* Nicholas Satterly [mailto:nfsatte...@gmail.com] *Sent:* 10 October 2012 13:06 *To:* ganglia-developers@lists.sourceforge.net *Subject:* [Ganglia-developers] dynamic discovery of hosts in EC2 ** ** Hi, ** ** I've been hacking on the ganglia gmond code to get the agent to auto-discover other servers in its cluster when running in EC2 [1]. It works a lot like the way elasticsearch does [2]. ** ** Does anyone have any suggestions on how I might get gmetric to work in a scalable way if it can't rely on the UDP send destinations being listed in the gmond.conf file? It really is a show-stopper for us at the moment which is unfortunate because gmond would work brilliantly in EC2 with these changes. ** ** Thanks in advance, Nick ** ** [1] https://github.com/satterly/monitor-core [2] http://www.elasticsearch.org/guide/reference/modules/discovery/ec2.html and http://www.elasticsearch.org/tutorials/2011/08/22/elasticsearch-on-ec2.html ** ** ** ** ** ** -- IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you. -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev___ Ganglia-developers mailing list Ganglia-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-developers
Re: [Ganglia-developers] dynamic discovery of hosts in EC2
On Oct 10, 2012, at 7:38 AM, Paul Hewlett wrote: Hi Nick Modify gmond to write a special file /etc/ganglia/ec2.conf with the discovered instances and then modify gmetric to read that file – using a cmdline option perhaps This change should be lightweight enough for gmetric I haven't looked at this code specifically, but just a general suggestion: A process shouldn't typically be able to write to files in /etc. Any data that gmond needs to write out should probably go somewhere in /var. alex -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ Ganglia-developers mailing list Ganglia-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-developers
Re: [Ganglia-developers] dynamic discovery of hosts in EC2
It's currently writing to /var/lib/ganglia/gmond-ec2.conf but I'm flexible... https://github.com/satterly/monitor-core/blob/master/lib/libgmond.c#L614 --Nick. On Fri, Oct 12, 2012 at 4:02 PM, Paul Hewlett paul.hewl...@arm.com wrote: Hi Alex You are correct - it should be /var/lib/ganglia/ec2.conf or maybe even /tmp/ganglia? Also If the data does not need to persist between reboots then it could be /dev/shm/ganglia/ec2.conf... Regards -- Paul Hewlett X25250 http://www.theregister.co.uk/2012/06/25/rbs_natwest_what_went_wrong/ ARM Ltd 110 Fulbourn Road, Cambridge, CB1 9NJ Tel: +44 (0)1223 405923 skype: paul-at-arm www.arm.com -Original Message- From: Alex Dean [mailto:a...@crackpot.org] Sent: 12 October 2012 15:56 To: ganglia-developers@lists.sourceforge.net Subject: Re: [Ganglia-developers] dynamic discovery of hosts in EC2 On Oct 10, 2012, at 7:38 AM, Paul Hewlett wrote: Hi Nick Modify gmond to write a special file /etc/ganglia/ec2.conf with the discovered instances and then modify gmetric to read that file - using a cmdline option perhaps This change should be lightweight enough for gmetric I haven't looked at this code specifically, but just a general suggestion: A process shouldn't typically be able to write to files in /etc. Any data that gmond needs to write out should probably go somewhere in /var. alex -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ Ganglia-developers mailing list Ganglia-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-developers -- IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you. -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev ___ Ganglia-developers mailing list Ganglia-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-developers -- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev___ Ganglia-developers mailing list Ganglia-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-developers
Re: [Ganglia-developers] dynamic discovery of hosts in EC2
Hi Nick Modify gmond to write a special file /etc/ganglia/ec2.conf with the discovered instances and then modify gmetric to read that file - using a cmdline option perhaps This change should be lightweight enough for gmetric Regards -- Paul Hewlett X25250 http://www.theregister.co.uk/2012/06/25/rbs_natwest_what_went_wrong/ ARM Ltd 110 Fulbourn Road, Cambridge, CB1 9NJ Tel: +44 (0)1223 405923 skype: paul-at-arm www.arm.comhttp://www.arm.com/ From: Nicholas Satterly [mailto:nfsatte...@gmail.com] Sent: 10 October 2012 13:06 To: ganglia-developers@lists.sourceforge.net Subject: [Ganglia-developers] dynamic discovery of hosts in EC2 Hi, I've been hacking on the ganglia gmond code to get the agent to auto-discover other servers in its cluster when running in EC2 [1]. It works a lot like the way elasticsearch does [2]. Does anyone have any suggestions on how I might get gmetric to work in a scalable way if it can't rely on the UDP send destinations being listed in the gmond.conf file? It really is a show-stopper for us at the moment which is unfortunate because gmond would work brilliantly in EC2 with these changes. Thanks in advance, Nick [1] https://github.com/satterly/monitor-core [2] http://www.elasticsearch.org/guide/reference/modules/discovery/ec2.html and http://www.elasticsearch.org/tutorials/2011/08/22/elasticsearch-on-ec2.html -- IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you.-- Don't let slow site performance ruin your business. Deploy New Relic APM Deploy New Relic app performance management and know exactly what is happening inside your Ruby, Python, PHP, Java, and .NET app Try New Relic at no cost today and get our sweet Data Nerd shirt too! http://p.sf.net/sfu/newrelic-dev2dev___ Ganglia-developers mailing list Ganglia-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-developers
