Re: Cloudstack metrics, usage collection and reporting?
I found a libvirt exporter written and it works great with CentOS 7 KVMs and Prometheus: https://github.com/kumina/libvirt_exporter CentOS7 x64 binary http://tmp.nux.ro/R7b-libvirt_exporter It could be used to keep an eye on bandwidth, here are some snaps: http://img.nux.ro/vK7-libvirtexporter/ hth Lucian -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - > From: "Will Stevens" > To: "dev" > Cc: "Pierre-Luc Dion" , "users" > > Sent: Tuesday, 20 March, 2018 18:21:16 > Subject: Re: Cloudstack metrics, usage collection and reporting? > Ya, we have done some of our own instrumentation, but it has been more > 'around' CloudStack than integrating directly into it (so far). That said, > I think PLD has plans to start working on some initiatives inside ACS, but > I will let him speak to that. > > *Will Stevens* > Chief Technology Officer > c 514.826.0190 > > <https://goo.gl/NYZ8KK> > > On Tue, Mar 20, 2018 at 2:11 PM, Nux! wrote: > >> That sounds cool, haven't heard about this project. >> >> My first thought was whether we can input cloud usage data into >> elasticsearch or something like this, seems close enough. >> >> -- >> Sent from the Delta quadrant using Borg technology! >> >> Nux! >> www.nux.ro >> >> ----- Original Message ----- >> > From: "Will Stevens" >> > To: "dev" , "Pierre-Luc Dion" < >> pd...@cloudops.com> >> > Cc: "users" >> > Sent: Tuesday, 20 March, 2018 10:35:48 >> > Subject: Re: Cloudstack metrics, usage collection and reporting? >> >> > PLD, this is a thread you will likely be interested in. I know you have >> > done a lot with OpenTSDB and are looking at adding metrics to the VR. >> > >> > On Mar 20, 2018 6:22 AM, "Nux!" wrote: >> > >> >> Prometheus and the ACS plugin are quite cool, I could see them being >> quite >> >> handy, thanks to whoever built it! :-) >> >> >> >> Has anyone had a go at putting cloud usage data into some of these new >> >> trendy shiny toys? I'd be most interested in network/traffic stats. >> >> >> >> Regards, >> >> Lucian >> >> >> >> -- >> >> Sent from the Delta quadrant using Borg technology! >> >> >> >> Nux! >> >> www.nux.ro >> >> >> >> - Original Message - >> >> > From: "Paul Angus" >> >> > To: "users" , "dev" < >> >> dev@cloudstack.apache.org> >> >> > Sent: Thursday, 8 March, 2018 14:56:25 >> >> > Subject: RE: Cloudstack metrics, usage collection and reporting? >> >> >> >> > 😉 >> >> > >> >> > >> >> > Kind regards, >> >> > >> >> > Paul Angus >> >> > >> >> > paul.an...@shapeblue.com >> >> > www.shapeblue.com >> >> > 53 Chandos Place, Covent Garden, London WC2N 4HSUK >> >> > @shapeblue >> >> > >> >> > >> >> > >> >> > >> >> > -Original Message- >> >> > From: Nux! >> >> > Sent: 08 March 2018 14:52 >> >> > To: dev >> >> > Cc: users >> >> > Subject: Re: Cloudstack metrics, usage collection and reporting? >> >> > >> >> > Thanks! >> >> > >> >> > -- >> >> > Sent from the Delta quadrant using Borg technology! >> >> > >> >> > Nux! >> >> > www.nux.ro >> >> > >> >> > - Original Message - >> >> >> From: "Paul Angus" >> >> >> To: "users" >> >> >> Cc: "dev" >> >> >> Sent: Thursday, 8 March, 2018 14:36:10 >> >> >> Subject: RE: Cloudstack metrics, usage collection and reporting? >> >> > >> >> >> https://cwiki.apache.org/confluence/display/CLOUDSTACK/ >> CloudStack+Metr >> >> >> ics+Exporter+for+Prometheus >> >> >> >> >> >> >> >> >> Kind regards, >> >> >> >> >> >> Paul Angus >> >> >> >> >> >> paul.an...@shapeblue.com >> >> >> www.shapeblue.com >> >> >> 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> -Original Message- >> >> >> From: Nux! >> >> >> Sent: 08 March 2018 14:23 >> >> >> To: users >> >> >> Cc: dev >> >> >> Subject: Cloudstack metrics, usage collection and reporting? >> >> >> >> >> >> Hi folks, >> >> >> >> >> >> I was looking at the state of metrics, usage stats of Cloudstack and >> >> >> integration in various tools, for monitoring, billing and so on. >> Nothing >> >> >> exciting came up. >> >> >> Is anyone doing or heard of interesting stuff with this? Maybe some >> >> >> Prometheus, Elasticsearch, Grafana or anything else? >> >> >> >> >> >> >> >> >> -- >> >> >> Sent from the Delta quadrant using Borg technology! >> >> >> >> >> >> Nux! >> >> > > www.nux.ro
Re: Cloudstack metrics, usage collection and reporting?
Ya, we have done some of our own instrumentation, but it has been more 'around' CloudStack than integrating directly into it (so far). That said, I think PLD has plans to start working on some initiatives inside ACS, but I will let him speak to that. *Will Stevens* Chief Technology Officer c 514.826.0190 <https://goo.gl/NYZ8KK> On Tue, Mar 20, 2018 at 2:11 PM, Nux! wrote: > That sounds cool, haven't heard about this project. > > My first thought was whether we can input cloud usage data into > elasticsearch or something like this, seems close enough. > > -- > Sent from the Delta quadrant using Borg technology! > > Nux! > www.nux.ro > > - Original Message - > > From: "Will Stevens" > > To: "dev" , "Pierre-Luc Dion" < > pd...@cloudops.com> > > Cc: "users" > > Sent: Tuesday, 20 March, 2018 10:35:48 > > Subject: Re: Cloudstack metrics, usage collection and reporting? > > > PLD, this is a thread you will likely be interested in. I know you have > > done a lot with OpenTSDB and are looking at adding metrics to the VR. > > > > On Mar 20, 2018 6:22 AM, "Nux!" wrote: > > > >> Prometheus and the ACS plugin are quite cool, I could see them being > quite > >> handy, thanks to whoever built it! :-) > >> > >> Has anyone had a go at putting cloud usage data into some of these new > >> trendy shiny toys? I'd be most interested in network/traffic stats. > >> > >> Regards, > >> Lucian > >> > >> -- > >> Sent from the Delta quadrant using Borg technology! > >> > >> Nux! > >> www.nux.ro > >> > >> - Original Message - > >> > From: "Paul Angus" > >> > To: "users" , "dev" < > >> dev@cloudstack.apache.org> > >> > Sent: Thursday, 8 March, 2018 14:56:25 > >> > Subject: RE: Cloudstack metrics, usage collection and reporting? > >> > >> > 😉 > >> > > >> > > >> > Kind regards, > >> > > >> > Paul Angus > >> > > >> > paul.an...@shapeblue.com > >> > www.shapeblue.com > >> > 53 Chandos Place, Covent Garden, London WC2N 4HSUK > >> > @shapeblue > >> > > >> > > >> > > >> > > >> > -Original Message- > >> > From: Nux! > >> > Sent: 08 March 2018 14:52 > >> > To: dev > >> > Cc: users > >> > Subject: Re: Cloudstack metrics, usage collection and reporting? > >> > > >> > Thanks! > >> > > >> > -- > >> > Sent from the Delta quadrant using Borg technology! > >> > > >> > Nux! > >> > www.nux.ro > >> > > >> > - Original Message - > >> >> From: "Paul Angus" > >> >> To: "users" > >> >> Cc: "dev" > >> >> Sent: Thursday, 8 March, 2018 14:36:10 > >> >> Subject: RE: Cloudstack metrics, usage collection and reporting? > >> > > >> >> https://cwiki.apache.org/confluence/display/CLOUDSTACK/ > CloudStack+Metr > >> >> ics+Exporter+for+Prometheus > >> >> > >> >> > >> >> Kind regards, > >> >> > >> >> Paul Angus > >> >> > >> >> paul.an...@shapeblue.com > >> >> www.shapeblue.com > >> >> 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > >> >> > >> >> > >> >> > >> >> > >> >> -Original Message- > >> >> From: Nux! > >> >> Sent: 08 March 2018 14:23 > >> >> To: users > >> >> Cc: dev > >> >> Subject: Cloudstack metrics, usage collection and reporting? > >> >> > >> >> Hi folks, > >> >> > >> >> I was looking at the state of metrics, usage stats of Cloudstack and > >> >> integration in various tools, for monitoring, billing and so on. > Nothing > >> >> exciting came up. > >> >> Is anyone doing or heard of interesting stuff with this? Maybe some > >> >> Prometheus, Elasticsearch, Grafana or anything else? > >> >> > >> >> > >> >> -- > >> >> Sent from the Delta quadrant using Borg technology! > >> >> > >> >> Nux! > >> > > www.nux.ro >
Re: Cloudstack metrics, usage collection and reporting?
That sounds cool, haven't heard about this project. My first thought was whether we can input cloud usage data into elasticsearch or something like this, seems close enough. -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - > From: "Will Stevens" > To: "dev" , "Pierre-Luc Dion" > Cc: "users" > Sent: Tuesday, 20 March, 2018 10:35:48 > Subject: Re: Cloudstack metrics, usage collection and reporting? > PLD, this is a thread you will likely be interested in. I know you have > done a lot with OpenTSDB and are looking at adding metrics to the VR. > > On Mar 20, 2018 6:22 AM, "Nux!" wrote: > >> Prometheus and the ACS plugin are quite cool, I could see them being quite >> handy, thanks to whoever built it! :-) >> >> Has anyone had a go at putting cloud usage data into some of these new >> trendy shiny toys? I'd be most interested in network/traffic stats. >> >> Regards, >> Lucian >> >> -- >> Sent from the Delta quadrant using Borg technology! >> >> Nux! >> www.nux.ro >> >> - Original Message ----- >> > From: "Paul Angus" >> > To: "users" , "dev" < >> dev@cloudstack.apache.org> >> > Sent: Thursday, 8 March, 2018 14:56:25 >> > Subject: RE: Cloudstack metrics, usage collection and reporting? >> >> > 😉 >> > >> > >> > Kind regards, >> > >> > Paul Angus >> > >> > paul.an...@shapeblue.com >> > www.shapeblue.com >> > 53 Chandos Place, Covent Garden, London WC2N 4HSUK >> > @shapeblue >> > >> > >> > >> > >> > -Original Message- >> > From: Nux! >> > Sent: 08 March 2018 14:52 >> > To: dev >> > Cc: users >> > Subject: Re: Cloudstack metrics, usage collection and reporting? >> > >> > Thanks! >> > >> > -- >> > Sent from the Delta quadrant using Borg technology! >> > >> > Nux! >> > www.nux.ro >> > >> > - Original Message - >> >> From: "Paul Angus" >> >> To: "users" >> >> Cc: "dev" >> >> Sent: Thursday, 8 March, 2018 14:36:10 >> >> Subject: RE: Cloudstack metrics, usage collection and reporting? >> > >> >> https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Metr >> >> ics+Exporter+for+Prometheus >> >> >> >> >> >> Kind regards, >> >> >> >> Paul Angus >> >> >> >> paul.an...@shapeblue.com >> >> www.shapeblue.com >> >> 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue >> >> >> >> >> >> >> >> >> >> -Original Message- >> >> From: Nux! >> >> Sent: 08 March 2018 14:23 >> >> To: users >> >> Cc: dev >> >> Subject: Cloudstack metrics, usage collection and reporting? >> >> >> >> Hi folks, >> >> >> >> I was looking at the state of metrics, usage stats of Cloudstack and >> >> integration in various tools, for monitoring, billing and so on. Nothing >> >> exciting came up. >> >> Is anyone doing or heard of interesting stuff with this? Maybe some >> >> Prometheus, Elasticsearch, Grafana or anything else? >> >> >> >> >> >> -- >> >> Sent from the Delta quadrant using Borg technology! >> >> >> >> Nux! >> > > www.nux.ro
Re: Cloudstack metrics, usage collection and reporting?
PLD, this is a thread you will likely be interested in. I know you have done a lot with OpenTSDB and are looking at adding metrics to the VR. On Mar 20, 2018 6:22 AM, "Nux!" wrote: > Prometheus and the ACS plugin are quite cool, I could see them being quite > handy, thanks to whoever built it! :-) > > Has anyone had a go at putting cloud usage data into some of these new > trendy shiny toys? I'd be most interested in network/traffic stats. > > Regards, > Lucian > > -- > Sent from the Delta quadrant using Borg technology! > > Nux! > www.nux.ro > > - Original Message - > > From: "Paul Angus" > > To: "users" , "dev" < > dev@cloudstack.apache.org> > > Sent: Thursday, 8 March, 2018 14:56:25 > > Subject: RE: Cloudstack metrics, usage collection and reporting? > > > 😉 > > > > > > Kind regards, > > > > Paul Angus > > > > paul.an...@shapeblue.com > > www.shapeblue.com > > 53 Chandos Place, Covent Garden, London WC2N 4HSUK > > @shapeblue > > > > > > > > > > -Original Message- > > From: Nux! > > Sent: 08 March 2018 14:52 > > To: dev > > Cc: users > > Subject: Re: Cloudstack metrics, usage collection and reporting? > > > > Thanks! > > > > -- > > Sent from the Delta quadrant using Borg technology! > > > > Nux! > > www.nux.ro > > > > - Original Message - > >> From: "Paul Angus" > >> To: "users" > >> Cc: "dev" > >> Sent: Thursday, 8 March, 2018 14:36:10 > >> Subject: RE: Cloudstack metrics, usage collection and reporting? > > > >> https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Metr > >> ics+Exporter+for+Prometheus > >> > >> > >> Kind regards, > >> > >> Paul Angus > >> > >> paul.an...@shapeblue.com > >> www.shapeblue.com > >> 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > >> > >> > >> > >> > >> -Original Message- > >> From: Nux! > >> Sent: 08 March 2018 14:23 > >> To: users > >> Cc: dev > >> Subject: Cloudstack metrics, usage collection and reporting? > >> > >> Hi folks, > >> > >> I was looking at the state of metrics, usage stats of Cloudstack and > >> integration in various tools, for monitoring, billing and so on. Nothing > >> exciting came up. > >> Is anyone doing or heard of interesting stuff with this? Maybe some > >> Prometheus, Elasticsearch, Grafana or anything else? > >> > >> > >> -- > >> Sent from the Delta quadrant using Borg technology! > >> > >> Nux! > > > www.nux.ro >
Re: Cloudstack metrics, usage collection and reporting?
Prometheus and the ACS plugin are quite cool, I could see them being quite handy, thanks to whoever built it! :-) Has anyone had a go at putting cloud usage data into some of these new trendy shiny toys? I'd be most interested in network/traffic stats. Regards, Lucian -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - > From: "Paul Angus" > To: "users" , "dev" > Sent: Thursday, 8 March, 2018 14:56:25 > Subject: RE: Cloudstack metrics, usage collection and reporting? > 😉 > > > Kind regards, > > Paul Angus > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK > @shapeblue > > > > > -Original Message----- > From: Nux! > Sent: 08 March 2018 14:52 > To: dev > Cc: users > Subject: Re: Cloudstack metrics, usage collection and reporting? > > Thanks! > > -- > Sent from the Delta quadrant using Borg technology! > > Nux! > www.nux.ro > > - Original Message ----- >> From: "Paul Angus" >> To: "users" >> Cc: "dev" >> Sent: Thursday, 8 March, 2018 14:36:10 >> Subject: RE: Cloudstack metrics, usage collection and reporting? > >> https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Metr >> ics+Exporter+for+Prometheus >> >> >> Kind regards, >> >> Paul Angus >> >> paul.an...@shapeblue.com >> www.shapeblue.com >> 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue >> >> >> >> >> -Original Message- >> From: Nux! >> Sent: 08 March 2018 14:23 >> To: users >> Cc: dev >> Subject: Cloudstack metrics, usage collection and reporting? >> >> Hi folks, >> >> I was looking at the state of metrics, usage stats of Cloudstack and >> integration in various tools, for monitoring, billing and so on. Nothing >> exciting came up. >> Is anyone doing or heard of interesting stuff with this? Maybe some >> Prometheus, Elasticsearch, Grafana or anything else? >> >> >> -- >> Sent from the Delta quadrant using Borg technology! >> >> Nux! > > www.nux.ro
RE: Cloudstack metrics, usage collection and reporting?
😉 Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Nux! Sent: 08 March 2018 14:52 To: dev Cc: users Subject: Re: Cloudstack metrics, usage collection and reporting? Thanks! -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - > From: "Paul Angus" > To: "users" > Cc: "dev" > Sent: Thursday, 8 March, 2018 14:36:10 > Subject: RE: Cloudstack metrics, usage collection and reporting? > https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Metr > ics+Exporter+for+Prometheus > > > Kind regards, > > Paul Angus > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue > > > > > -Original Message- > From: Nux! > Sent: 08 March 2018 14:23 > To: users > Cc: dev > Subject: Cloudstack metrics, usage collection and reporting? > > Hi folks, > > I was looking at the state of metrics, usage stats of Cloudstack and > integration in various tools, for monitoring, billing and so on. Nothing > exciting came up. > Is anyone doing or heard of interesting stuff with this? Maybe some > Prometheus, Elasticsearch, Grafana or anything else? > > > -- > Sent from the Delta quadrant using Borg technology! > > Nux! > www.nux.ro
Re: Cloudstack metrics, usage collection and reporting?
Thanks! -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro - Original Message - > From: "Paul Angus" > To: "users" > Cc: "dev" > Sent: Thursday, 8 March, 2018 14:36:10 > Subject: RE: Cloudstack metrics, usage collection and reporting? > https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Metrics+Exporter+for+Prometheus > > > Kind regards, > > Paul Angus > > paul.an...@shapeblue.com > www.shapeblue.com > 53 Chandos Place, Covent Garden, London WC2N 4HSUK > @shapeblue > > > > > -Original Message- > From: Nux! > Sent: 08 March 2018 14:23 > To: users > Cc: dev > Subject: Cloudstack metrics, usage collection and reporting? > > Hi folks, > > I was looking at the state of metrics, usage stats of Cloudstack and > integration > in various tools, for monitoring, billing and so on. Nothing exciting came up. > Is anyone doing or heard of interesting stuff with this? Maybe some > Prometheus, > Elasticsearch, Grafana or anything else? > > > -- > Sent from the Delta quadrant using Borg technology! > > Nux! > www.nux.ro
RE: Cloudstack metrics, usage collection and reporting?
https://cwiki.apache.org/confluence/display/CLOUDSTACK/CloudStack+Metrics+Exporter+for+Prometheus Kind regards, Paul Angus paul.an...@shapeblue.com www.shapeblue.com 53 Chandos Place, Covent Garden, London WC2N 4HSUK @shapeblue -Original Message- From: Nux! Sent: 08 March 2018 14:23 To: users Cc: dev Subject: Cloudstack metrics, usage collection and reporting? Hi folks, I was looking at the state of metrics, usage stats of Cloudstack and integration in various tools, for monitoring, billing and so on. Nothing exciting came up. Is anyone doing or heard of interesting stuff with this? Maybe some Prometheus, Elasticsearch, Grafana or anything else? -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro
Re: Cloudstack metrics, usage collection and reporting?
Only have https://github.com/resmo/awesome-cloudstack#montitoring-and-graphs
