[Ganglia-general] Slides from my talk at MySQL Conf mentioning ganglia
Slides are here: http://www.kitchensoap.com/2007/04/27/slides-from-capacity-planning-for-lamp-talk-at-mysql-conf-2007/ A lot of folks at the talk asked about rrd storage, and some folks nodded when I mentioned we store our rrds on ramdisk and then sync them to disk periodically. Also a couple of people mentioned hacking on the templates, so I thought I'd mention what we've done at Flickr: - put a stacked graph of the chosen metric *above* the individual node rrds in a cluster. This way, we can see things like "total hits" without having to wait for >100 nodes to draw their own graphs. - changed the web frontend so you can put arbitrary time values, like h,m,d,w,m for hours, months, etc. So: "r=8h" will show you 8 hours. - added the custom graph add-on (thank you, Alex you deserve a beer bought for you) (from here: http://wtf.ath.cx/screenshots.html) My impression is that a lot of folks in the web world use ganglia, and have written again and again some of these changes to make it more useful for them. I'm almost sure that the majority of hacks are on the interface, not really with gmond or gmetad code. We have custom gmetrics for measuring Squid use, memcached, MySQL, Apache, even OS level metrics (context switches, for example) that others would find super useful. I realized at the talk that I got the first version of my memcached gmetric script from someone at Facebook, secondhand, before I added to it. Is there any plans to revive the gmetric repository ? I think a lot on this list would contribute to it. I would. -john __ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com
Re: [Ganglia-general] Slides from my talk at MySQL Conf mentioning ganglia
Hi John: Thanks for your mention at MySQL Conf! There are talks about re-vamping the Ganglia website in ganglia-developers and I asked about the gmetric repository so hopefully it will get put back. Regarding your enhancements, would it be possible to post some screenshots? Perhaps others may be interested in them too. If you have simple patches against SVN trunk, and other people want them added, I could check those in. Cheers, Bernard On 4/27/07, john allspaw <[EMAIL PROTECTED]> wrote: Slides are here: http://www.kitchensoap.com/2007/04/27/slides-from-capacity-planning-for-lamp-talk-at-mysql-conf-2007/ A lot of folks at the talk asked about rrd storage, and some folks nodded when I mentioned we store our rrds on ramdisk and then sync them to disk periodically. Also a couple of people mentioned hacking on the templates, so I thought I'd mention what we've done at Flickr: - put a stacked graph of the chosen metric *above* the individual node rrds in a cluster. This way, we can see things like "total hits" without having to wait for >100 nodes to draw their own graphs. - changed the web frontend so you can put arbitrary time values, like h,m,d,w,m for hours, months, etc. So: "r=8h" will show you 8 hours. - added the custom graph add-on (thank you, Alex you deserve a beer bought for you) (from here: http://wtf.ath.cx/screenshots.html) My impression is that a lot of folks in the web world use ganglia, and have written again and again some of these changes to make it more useful for them. I'm almost sure that the majority of hacks are on the interface, not really with gmond or gmetad code. We have custom gmetrics for measuring Squid use, memcached, MySQL, Apache, even OS level metrics (context switches, for example) that others would find super useful. I realized at the talk that I got the first version of my memcached gmetric script from someone at Facebook, secondhand, before I added to it. Is there any plans to revive the gmetric repository ? I think a lot on this list would contribute to it. I would. -john __ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com - This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ ___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general
Re: [Ganglia-general] Slides from my talk at MySQL Conf mentioning ganglia
as far as the plans to revive the gmetric repository... i just went to hack up a fix to the bot mess and found that someone else has already been working on the problem too... since the form now has a verification field. whoever is working the gmetric repository please feel free to use the verification code i worked up at http://ganglia.info/form_verify/ . if i don't hear someone in the next few days... i'll just go ahead and make it work. want to get the repository up and running soon (given the demand). btw, i love flickr... i have a pro account with about 6000 images... thanks for the great service. -matt On Fri, 2007-04-27 at 06:00 -0700, john allspaw wrote: > Slides are here: > http://www.kitchensoap.com/2007/04/27/slides-from-capacity-planning-for-lamp-talk-at-mysql-conf-2007/ > > A lot of folks at the talk asked about rrd storage, and some folks nodded > when I mentioned we store our rrds on ramdisk and then sync them to disk > periodically. Also a couple of people mentioned hacking on the templates, so > I thought I'd mention what we've done at Flickr: > > - put a stacked graph of the chosen metric *above* the individual node rrds > in a cluster. This way, we can see things like "total hits" without having > to wait for >100 nodes to draw their own graphs. > - changed the web frontend so you can put arbitrary time values, like > h,m,d,w,m for hours, months, etc. So: "r=8h" will show you 8 hours. > - added the custom graph add-on (thank you, Alex you deserve a beer bought > for you) > (from here: http://wtf.ath.cx/screenshots.html) > > My impression is that a lot of folks in the web world use ganglia, and have > written again and again some of these changes to make it more useful for > them. I'm almost sure that the majority of hacks are on the interface, not > really with gmond or gmetad code. We have custom gmetrics for measuring Squid > use, memcached, MySQL, Apache, even OS level metrics (context switches, for > example) that others would find super useful. I realized at the talk that I > got the first version of my memcached gmetric script from someone at > Facebook, secondhand, before I added to it. > > Is there any plans to revive the gmetric repository ? I think a lot on this > list would contribute to it. I would. > -john > > > > __ > Do You Yahoo!? > Tired of spam? Yahoo! Mail has the best spam protection around > http://mail.yahoo.com > > - > This SF.net email is sponsored by DB2 Express > Download DB2 Express C - the FREE version of DB2 express and take > control of your XML. No limits. Just data. Click to get it now. > http://sourceforge.net/powerbar/db2/ > ___ > Ganglia-general mailing list > Ganglia-general@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/ganglia-general
Re: [Ganglia-general] Slides from my talk at MySQL Conf mentioning ganglia
i posted your slide on the ganglia web site (http://ganglia.info)... hope that's ok... happy to hear that ganglia is so useful for you and your team. flickr rocks -matt On Fri, 2007-04-27 at 06:00 -0700, john allspaw wrote: > Slides are here: > http://www.kitchensoap.com/2007/04/27/slides-from-capacity-planning-for-lamp-talk-at-mysql-conf-2007/ > > A lot of folks at the talk asked about rrd storage, and some folks nodded > when I mentioned we store our rrds on ramdisk and then sync them to disk > periodically. Also a couple of people mentioned hacking on the templates, so > I thought I'd mention what we've done at Flickr: > > - put a stacked graph of the chosen metric *above* the individual node rrds > in a cluster. This way, we can see things like "total hits" without having > to wait for >100 nodes to draw their own graphs. > - changed the web frontend so you can put arbitrary time values, like > h,m,d,w,m for hours, months, etc. So: "r=8h" will show you 8 hours. > - added the custom graph add-on (thank you, Alex you deserve a beer bought > for you) > (from here: http://wtf.ath.cx/screenshots.html) > > My impression is that a lot of folks in the web world use ganglia, and have > written again and again some of these changes to make it more useful for > them. I'm almost sure that the majority of hacks are on the interface, not > really with gmond or gmetad code. We have custom gmetrics for measuring Squid > use, memcached, MySQL, Apache, even OS level metrics (context switches, for > example) that others would find super useful. I realized at the talk that I > got the first version of my memcached gmetric script from someone at > Facebook, secondhand, before I added to it. > > Is there any plans to revive the gmetric repository ? I think a lot on this > list would contribute to it. I would. > -john > > > > __ > Do You Yahoo!? > Tired of spam? Yahoo! Mail has the best spam protection around > http://mail.yahoo.com > > - > This SF.net email is sponsored by DB2 Express > Download DB2 Express C - the FREE version of DB2 express and take > control of your XML. No limits. Just data. Click to get it now. > http://sourceforge.net/powerbar/db2/ > ___ > Ganglia-general mailing list > Ganglia-general@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/ganglia-general
