Re: [openstack-dev] [Ceilometer] what's in scope of Ceilometer
On Thu, Aug 29 2013, Gordon Chung wrote: the first question is, Ceilometer currently does metering/alarming/maybe a few other things... will it go beyond that? specifically: capacity planning, optimization, dashboard(i assume this falls under horizon/ceilometer plugin work), analytics. they're pretty broad items so i would think they would probably end up being separate projects? I think we can extend Ceilometer API to help build such tools, but I don't think we should build these tools inside Ceilometer. another question is what metrics will we capture. some of the product teams we have collect metrics on datacenter memory/cpu utilization, cluster cpu/memory/vm, and a bunch of other clustered stuff. i'm a nova-idiot, but is this info possible to retrieve? is the consensus that Ceilometer will collect anything and everything the other projects allow for? Yeah, I think that Ceilometer's the place to collect anything. I don't know if that metrics you are talking about are collectable through Nova though. -- Julien Danjou -- Free Software hacker - independent consultant -- http://julien.danjou.info signature.asc Description: PGP signature ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Ceilometer] what's in scope of Ceilometer
Gordon Chung wrote on 2013-08-29: so we're in the process of selling Ceilometer to product teams so that they'll adopt it and we'll get more funding :). one item that comes up from product teams is 'what will Ceilometer be able to do and where does the product takeover and add value?' the first question is, Ceilometer currently does metering/alarming/maybe a few other things... will it go beyond that? specifically: capacity planning, optimization, dashboard(i assume this falls under horizon/ceilometer plugin work), analytics. they're pretty broad items so i would think they would probably end up being separate projects? another question is what metrics will we capture. some of the product teams we have collect metrics on datacenter memory/cpu utilization, cluster cpu/memory/vm, and a bunch of other clustered stuff. i'm a nova-idiot, but is this info possible to retrieve? is the consensus that Ceilometer will collect anything and everything the other projects allow for? We're currently implementing a plugin-able framework in nova to collect metrics from nova compute nodes and send them into message bus, see https://blueprints.launchpad.net/nova/+spec/utilization-aware-scheduling for the patches of that, and also the corresponding ceilometer's notification listener https://review.openstack.org/42838 for that. Besides, the ceilometer hardware agent(https://blueprints.launchpad.net/ceilometer/+spec/monitoring-physical-devices)is the place where to poll for data from any other physical hosts. -Lianhao ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Ceilometer] what's in scope of Ceilometer
+1 I believe the important point here is to identify additional metrics required and the relevant attributes which can be specified and have them returned to the Collector. Then in turn the collector can either push/pull those metrics/etc into an Anlytics Engine and tools. Its not a good idea to start designing and building analytics engines etc into Ceilometer, it should just the monitor and collecting project. For the metrics Ceilometer is definitely the place to set and collect what metrics you need to know of for both the Hardware functions (cpu/mem/disk-i/o/nic utilisation etc etc) and also for some base application sets for example on an Apache server the number of TCP-sessions in utilisation etc etc. BR Alan -Original Message- From: Julien Danjou [mailto:jul...@danjou.info] Sent: August-29-13 4:20 AM To: Gordon Chung Cc: openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] [Ceilometer] what's in scope of Ceilometer On Thu, Aug 29 2013, Gordon Chung wrote: the first question is, Ceilometer currently does metering/alarming/maybe a few other things... will it go beyond that? specifically: capacity planning, optimization, dashboard(i assume this falls under horizon/ceilometer plugin work), analytics. they're pretty broad items so i would think they would probably end up being separate projects? I think we can extend Ceilometer API to help build such tools, but I don't think we should build these tools inside Ceilometer. another question is what metrics will we capture. some of the product teams we have collect metrics on datacenter memory/cpu utilization, cluster cpu/memory/vm, and a bunch of other clustered stuff. i'm a nova-idiot, but is this info possible to retrieve? is the consensus that Ceilometer will collect anything and everything the other projects allow for? Yeah, I think that Ceilometer's the place to collect anything. I don't know if that metrics you are talking about are collectable through Nova though. -- Julien Danjou -- Free Software hacker - independent consultant -- http://julien.danjou.info ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Ceilometer] what's in scope of Ceilometer
On 08/29/2013 05:20 AM, Julien Danjou wrote: On Thu, Aug 29 2013, Gordon Chung wrote: the first question is, Ceilometer currently does metering/alarming/maybe a few other things... will it go beyond that? specifically: capacity planning, optimization, dashboard(i assume this falls under horizon/ceilometer plugin work), analytics. they're pretty broad items so i would think they would probably end up being separate projects? I think we can extend Ceilometer API to help build such tools, but I don't think we should build these tools inside Ceilometer. sniff sniff I'm so happy to hear that I could cry. +1000 another question is what metrics will we capture. some of the product teams we have collect metrics on datacenter memory/cpu utilization, cluster cpu/memory/vm, and a bunch of other clustered stuff. i'm a nova-idiot, but is this info possible to retrieve? is the consensus that Ceilometer will collect anything and everything the other projects allow for? Yeah, I think that Ceilometer's the place to collect anything. I don't know if that metrics you are talking about are collectable through Nova though. Some of this data is collected from the vm and sent to the scheduler, but not exposed in the normal nova notifications (iirc). Internally we've been playing with Diamond for extracting this metrics from our compute nodes. A Diamond - CM bridge would be awesome. We're really pushing hard for the other openstack projects to make more use of the oslo notification framework and it's been well adopted so far. For some high volume services, like Swift, the notification system doesn't make sense, so there are efforts around things like Meniscus and logstash - notifications (or similar). Hope it helps! -S ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [Ceilometer] what's in scope of Ceilometer
so we're in the process of selling Ceilometer to product teams so that they'll adopt it and we'll get more funding :). one item that comes up from product teams is 'what will Ceilometer be able to do and where does the product takeover and add value?' the first question is, Ceilometer currently does metering/alarming/maybe a few other things... will it go beyond that? specifically: capacity planning, optimization, dashboard(i assume this falls under horizon/ceilometer plugin work), analytics. they're pretty broad items so i would think they would probably end up being separate projects? another question is what metrics will we capture. some of the product teams we have collect metrics on datacenter memory/cpu utilization, cluster cpu/memory/vm, and a bunch of other clustered stuff. i'm a nova-idiot, but is this info possible to retrieve? is the consensus that Ceilometer will collect anything and everything the other projects allow for? cheers, gordon chung openstack, ibm software standards email: chungg [at] ca.ibm.com phone: 905.413.5072___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
