Re: [Ganglia-general] Need help configuring clusters to use separate multicast IP
Ron, You will probably want to configure it to check more than 1 machine per cluster. That way if that machine is the one that goes down you don't lose visibility into the whole cluster. So here's an example I pulled from our gmetad server (changed the hostnames of course): data_source Application Servers app1 data_source Databases db1 data_source ETL etl1 data_source Elastic Search Cluster elasticsearch1 elasticsearch2 data_source Research Cluster admin1 admin2 gridname Mozilla Metrics I should note that each data source is on different multicast channels, but we always use the default port (8649) for gmond. Hopefully this helps! Cheers, -Xavier On 3/23/11 8:12 AM, Ron Cavallo wrote: I see. So I need a separate IP AND A SEPARATE PORT. Got it. Also, I use a single gmond in each cluster to aggregate the single cluster. I configure the gmetad to talk to only gmond from each cluster. Is that wrong? -RC Ron Cavallo Sr. Director, Infrastructure Saks Fifth Avenue / Saks Direct 12 East 49th Street New York, NY 10017 212-451-3807 (O) 212-940-5079 (fax) 646-315-0119(C) www.saks.com -Original Message- From: Seth Graham [mailto:set...@fnal.gov] Sent: Wednesday, March 23, 2011 11:06 AM To: Ron Cavallo Cc: Bernard Li; ganglia-general@lists.sourceforge.net Subject: Re: [Ganglia-general] Need help configuring clusters to use separate multicast IP That might work, but I don't think anyone sets up their ganglia so that a single gmond is trying aggregate all clusters. That's what the gmetad daemon is for. Also note that even though you have a separate multicast address for each cluster, the port still has to be unique. The port is what gmetad and the web frontend use to distinguish between clusters. You get really weird results if multiple data_source lines use the same port. An ideal configuration might be: Each of the 5 clusters has a unique gmond.conf, with its own multicast address and port number. The gmetad host has 5 data_source lines to query one host from each of the 5 clusters. On Mar 23, 2011, at 9:52 AM, Ron Cavallo wrote: I need some help. I am trying to configure my gmetad to collect from different clusters on different IP's. I have 5 clusters. This is my gmetad collections server's local gmond.conf configuration: /* Feel free to specify as many udp_send_channels as you like. Gmond used to only support having a single channel */ udp_send_channel { mcast_join = 239.2.11.72 port = 8649 ttl = 1 } /* You can specify as many udp_recv_channels as you like as well. */ udp_recv_channel { mcast_join = 239.2.11.71 port = 8649 bind = 239.2.11.71 } udp_recv_channel { mcast_join = 239.2.11.72 port = 8649 bind = 239.2.11.72 } udp_recv_channel { mcast_join = 239.2.11.73 port = 8649 bind = 239.2.11.73 } udp_recv_channel { mcast_join = 239.2.11.74 port = 8649 bind = 239.2.11.74 } udp_recv_channel { mcast_join = 239.2.11.75 port = 8649 bind = 239.2.11.75 } udp_recv_channel { port = 8649 } This is an excerpt from ONE OF THE CLUSTERS ABOVE (the .74 cluster) /* Feel free to specify as many udp_send_channels as you like. Gmond used to only support having a single channel */ udp_send_channel { mcast_join = 239.2.11.74 port = 8649 ttl = 1 } /* You can specify as many udp_recv_channels as you like as well. */ udp_recv_channel { mcast_join = 239.2.11.74 port = 8649 bind = 239.2.11.74 } I configure only one server in a cluster to be polled from the gmetad since that server has all of the cluster members information in it anyway. Here is how I have it configured to talk to the one gmond shown directly above: data_source SaksGoldApps 45 sd1mzp01lx.saksdirect.com:8649 -- Enable your software for Intel(R) Active Management Technology to meet the growing manageability and security demands of your customers. Businesses are taking advantage of Intel(R) vPro (TM) technology - will your software be a part of the solution? Download the Intel(R) Manageability Checker today! http://p.sf.net/sfu/intel-dev2devmar ___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general -- Enable your software for Intel(R) Active Management Technology to meet the growing manageability and security demands of your customers. Businesses are taking advantage of Intel(R) vPro (TM) technology - will your software be a part of the solution? Download the Intel(R) Manageability Checker today! http://p.sf.net/sfu/intel-dev2devmar ___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general
Re: [Ganglia-general] Need help configuring clusters to use separate multicast IP
Hey Ron, Your gmond on the gmetad server shouldn't have anything special in it. It should just be like any other gmond. Ours gmetad runs on one of the Application Servers so the gmond.conf on that machine would look the same as below. If your gmetad server is on its own you could set it up with a basic non-multicast gmond setup. So here's the relevant sections from gmond.conf: cluster { name = Application Servers owner = Mozilla Metrics } /* Feel free to specify as many udp_send_channels as you like. Gmond used to only support having a single channel */ udp_send_channel { bind_hostname = yes # Highly recommended, soon to be default. # This option tells gmond to use a source address # that resolves to the machine's hostname. Without # this, the metrics may appear to come from any # interface and the DNS names associated with # those IPs will be used to create the RRDs. mcast_join = 239.2.11.76 mcast_if = eth0 port = 8649 ttl = 1 } /* You can specify as many udp_recv_channels as you like as well. */ udp_recv_channel { mcast_join = 239.2.11.76 port = 8649 bind = 239.2.11.76 } /* You can specify as many tcp_accept_channels as you like to share an xml description of the state of the cluster */ tcp_accept_channel { port = 8649 } On 3/23/11 8:51 AM, Ron Cavallo wrote: Thank you Xavier. Can you give me an example of the gmond.conf that is located on the cluster Application Servers? Are there any changes needed in the gmond.conf on the gmetad server to allow Application Servers to be collected? I think we are getting closer to my problem... thanks all for the help. Ron Cavallo Sr. Director, Infrastructure Saks Fifth Avenue / Saks Direct 12 East 49th Street New York, NY 10017 212-451-3807 (O) 212-940-5079 (fax) 646-315-0119(C) www.saks.com -Original Message- From: Xavier Stevens [mailto:xstev...@mozilla.com] Sent: Wednesday, March 23, 2011 11:25 AM To: ganglia-general@lists.sourceforge.net Subject: Re: [Ganglia-general] Need help configuring clusters to use separate multicast IP Ron, You will probably want to configure it to check more than 1 machine per cluster. That way if that machine is the one that goes down you don't lose visibility into the whole cluster. So here's an example I pulled from our gmetad server (changed the hostnames of course): data_source Application Servers app1 data_source Databases db1 data_source ETL etl1 data_source Elastic Search Cluster elasticsearch1 elasticsearch2 data_source Research Cluster admin1 admin2 gridname Mozilla Metrics I should note that each data source is on different multicast channels, but we always use the default port (8649) for gmond. Hopefully this helps! Cheers, -Xavier On 3/23/11 8:12 AM, Ron Cavallo wrote: I see. So I need a separate IP AND A SEPARATE PORT. Got it. Also, I use a single gmond in each cluster to aggregate the single cluster. I configure the gmetad to talk to only gmond from each cluster. Is that wrong? -RC Ron Cavallo Sr. Director, Infrastructure Saks Fifth Avenue / Saks Direct 12 East 49th Street New York, NY 10017 212-451-3807 (O) 212-940-5079 (fax) 646-315-0119(C) www.saks.com -Original Message- From: Seth Graham [mailto:set...@fnal.gov] Sent: Wednesday, March 23, 2011 11:06 AM To: Ron Cavallo Cc: Bernard Li; ganglia-general@lists.sourceforge.net Subject: Re: [Ganglia-general] Need help configuring clusters to use separate multicast IP That might work, but I don't think anyone sets up their ganglia so that a single gmond is trying aggregate all clusters. That's what the gmetad daemon is for. Also note that even though you have a separate multicast address for each cluster, the port still has to be unique. The port is what gmetad and the web frontend use to distinguish between clusters. You get really weird results if multiple data_source lines use the same port. An ideal configuration might be: Each of the 5 clusters has a unique gmond.conf, with its own multicast address and port number. The gmetad host has 5 data_source lines to query one host from each of the 5 clusters. On Mar 23, 2011, at 9:52 AM, Ron Cavallo wrote: I need some help. I am trying to configure my gmetad to collect from different clusters on different IP's. I have 5 clusters. This is my gmetad collections server's local gmond.conf configuration: /* Feel free to specify as many udp_send_channels as you like. Gmond used to only support having a single channel */ udp_send_channel { mcast_join = 239.2.11.72 port = 8649 ttl = 1 } /* You can specify as many udp_recv_channels as you like as well. */ udp_recv_channel { mcast_join = 239.2.11.71 port = 8649 bind = 239.2.11.71 } udp_recv_channel { mcast_join = 239.2.11.72 port = 8649 bind = 239.2.11.72
[Ganglia-general] Network Module
Does the network module support tracking dropped packets? If so, what do I need to add to my gmond.conf. Also does Ganglia support a time resolution (for dropdown menu) less than 1 hour? Thanks, -Xavier -- ThinkGeek and WIRED's GeekDad team up for the Ultimate GeekDad Father's Day Giveaway. ONE MASSIVE PRIZE to the lucky parental unit. See the prize list and enter to win: http://p.sf.net/sfu/thinkgeek-promo ___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general