Re: [Openstack] [Ceilometer] Ganglia Ceilometer integration
> -Original Message- > From: shengjie_...@dell.com [mailto:shengjie_...@dell.com] > Sent: Thursday, January 10, 2013 1:38 AM > To: Jiang, Yunhong > Cc: openstack@lists.launchpad.net > Subject: RE: [Openstack] [Ceilometer] Ganglia Ceilometer integration > > >If Ganglia has interest in ceilometer data, we can achieve it through a > >specific > publisher, to put data into Gangalia. > > @yunhong, So it is more like the approach to CW or Synaps, isn't it? if the > monitoring system is interested in the meters from Ceilometer, we can have > different publishers to push data to different destinations(I think this can > be a Also, if some data from other monitor system like Gangalia is meaningful for openstack, they can be pushed to ceilometer also, either through special pollster to talk to those monitor system, or through REST API. > potential blueprint for be stored in a centralized storage just with > different namespaces). But that being said, if the backend is something > like Cassandra, Mongo or even Hbase, the system metrics(from gmond) and > openstack specific meters might be stored in a centralized storage just with > different namespaces. Thoughts? Considering we have a generalized storage abstraction, I fully agree that adding HBase is helpful. As to " be stored in a centralized storage just with different namespaces", isn't it be a deployment story? Thanks --jyh > - Shengjie ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [Ceilometer] Ganglia Ceilometer integration
>If Ganglia has interest in ceilometer data, we can achieve it through a >specific publisher, to put data into Gangalia. @yunhong, So it is more like the approach to CW or Synaps, isn't it? if the monitoring system is interested in the meters from Ceilometer, we can have different publishers to push data to different destinations(I think this can be a potential blueprint for ganglia). But that being said, if the backend is something like Cassandra, Mongo or even Hbase, the system metrics(from gmond) and openstack specific meters might be stored in a centralized storage just with different namespaces. Thoughts? - Shengjie ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [Ceilometer] Ganglia Ceilometer integration
My 2 cents. Basically there are two method to interact with Ganglia. One is to push all data from ceilometer into Gangalia, another one is your suggestion, put all data from Gangalia to ceilometer. According to current definition of ceilometer "infrastructure to collect measurements within OpenStack", IMHO, possibly we take not take data from Gangalia. If some data in Gangalia that are openstack/cloud specific, we should have pollster in ceilometer to get it. If Ganglia has interest in ceilometer data, we can achieve it through a specific publisher, to put data into Gangalia. Thanks --jyh > -Original Message- > From: openstack-bounces+yunhong.jiang=intel@lists.launchpad.net > [mailto:openstack-bounces+yunhong.jiang=intel@lists.launchpad.net] On > Behalf Of daniel_ley...@dell.com > Sent: Tuesday, January 08, 2013 11:23 PM > To: shengjie_...@dell.com > Cc: openstack@lists.launchpad.net > Subject: Re: [Openstack] [Ceilometer] Ganglia Ceilometer integration > > Shengjie, > > I've been thinking quite a lot about that recently. I was considering putting > up a > blueprint about supporting collection of metrics from Ganglia-monitored > servers and pushing them into Ceilometer, assuming there isn't anything > already up. > > I have run Ganglia on large numbers of servers in the past collecting metrics > and was thinking that, particularly with monitoring tie-ins with Ceilometer, > it > would be useful to have a producer that will scrape Ganglia's native XML-based > metric reports and push metrics into Ceilometer for persistence and analysis. > I > think that would complement the blueprint you raised about the HBase storage > backend for storing would could quickly become a vast amount of data - more > than the current backends could handle well - and if implemented properly > should work well with the multi-producer work that is going on. > > > Dan > > > > -Original Message- > From: openstack-bounces+daniel_leyden=dell@lists.launchpad.net > [mailto:openstack-bounces+daniel_leyden=dell@lists.launchpad.net] On > Behalf Of Min, Shengjie > Sent: 08 January 2013 13:02 > To: jul...@danjou.info > Cc: openstack@lists.launchpad.net > Subject: Re: [Openstack] [Ceilometer] Ganglia Ceilometer integration > > Hi Julien, > > Just look at the blueprints and your post, seems like there is some effort > around synaps, also something around heat, cloudwatch. Just trying to get a > clear picture about the vision and direction around monitoring area. > > Shengjie > > ___ > Mailing list: https://launchpad.net/~openstack > Post to : openstack@lists.launchpad.net > Unsubscribe : https://launchpad.net/~openstack > More help : https://help.launchpad.net/ListHelp > > ___ > Mailing list: https://launchpad.net/~openstack > Post to : openstack@lists.launchpad.net > Unsubscribe : https://launchpad.net/~openstack > More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [Ceilometer] Ganglia Ceilometer integration
I've had bad luck with ganglia. It tends to self pollute over time, especially in a lossy environment such as an elastic cloud. On Tue, Jan 8, 2013 at 7:23 AM, wrote: > Shengjie, > > I've been thinking quite a lot about that recently. I was considering > putting up a blueprint about supporting collection of metrics from > Ganglia-monitored servers and pushing them into Ceilometer, assuming there > isn't anything already up. > > I have run Ganglia on large numbers of servers in the past collecting > metrics and was thinking that, particularly with monitoring tie-ins with > Ceilometer, it would be useful to have a producer that will scrape > Ganglia's native XML-based metric reports and push metrics into Ceilometer > for persistence and analysis. I think that would complement the blueprint > you raised about the HBase storage backend for storing would could quickly > become a vast amount of data - more than the current backends could handle > well - and if implemented properly should work well with the multi-producer > work that is going on. > > > Dan > > > > -Original Message- > From: openstack-bounces+daniel_leyden=dell@lists.launchpad.net[mailto: > openstack-bounces+daniel_leyden=dell@lists.launchpad.net] On Behalf > Of Min, Shengjie > Sent: 08 January 2013 13:02 > To: jul...@danjou.info > Cc: openstack@lists.launchpad.net > Subject: Re: [Openstack] [Ceilometer] Ganglia Ceilometer integration > > Hi Julien, > > Just look at the blueprints and your post, seems like there is some effort > around synaps, also something around heat, cloudwatch. Just trying to get a > clear picture about the vision and direction around monitoring area. > > Shengjie > > ___ > Mailing list: https://launchpad.net/~openstack > Post to : openstack@lists.launchpad.net > Unsubscribe : https://launchpad.net/~openstack > More help : https://help.launchpad.net/ListHelp > > ___ > Mailing list: https://launchpad.net/~openstack > Post to : openstack@lists.launchpad.net > Unsubscribe : https://launchpad.net/~openstack > More help : https://help.launchpad.net/ListHelp > ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [Ceilometer] Ganglia Ceilometer integration
Shengjie, I've been thinking quite a lot about that recently. I was considering putting up a blueprint about supporting collection of metrics from Ganglia-monitored servers and pushing them into Ceilometer, assuming there isn't anything already up. I have run Ganglia on large numbers of servers in the past collecting metrics and was thinking that, particularly with monitoring tie-ins with Ceilometer, it would be useful to have a producer that will scrape Ganglia's native XML-based metric reports and push metrics into Ceilometer for persistence and analysis. I think that would complement the blueprint you raised about the HBase storage backend for storing would could quickly become a vast amount of data - more than the current backends could handle well - and if implemented properly should work well with the multi-producer work that is going on. Dan -Original Message- From: openstack-bounces+daniel_leyden=dell@lists.launchpad.net [mailto:openstack-bounces+daniel_leyden=dell@lists.launchpad.net] On Behalf Of Min, Shengjie Sent: 08 January 2013 13:02 To: jul...@danjou.info Cc: openstack@lists.launchpad.net Subject: Re: [Openstack] [Ceilometer] Ganglia Ceilometer integration Hi Julien, Just look at the blueprints and your post, seems like there is some effort around synaps, also something around heat, cloudwatch. Just trying to get a clear picture about the vision and direction around monitoring area. Shengjie ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [Ceilometer] Ganglia Ceilometer integration
Hi Julien, Just look at the blueprints and your post, seems like there is some effort around synaps, also something around heat, cloudwatch. Just trying to get a clear picture about the vision and direction around monitoring area. Shengjie ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [Ceilometer] Ganglia Ceilometer integration
On Tue, Jan 08 2013, shengjie_...@dell.com wrote: > Just out of curiosity, Have we ever had any previous threads discussing > about possibility of integrating Ceilometer with ganglia as a monitoring > approach? Didn't manage to find any from the mailing list archive. Doesn't ring a bell, indeed. -- Julien Danjou ;; Free Software hacker & freelance ;; http://julien.danjou.info pgpWaR3KSFLqz.pgp Description: PGP signature ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
