Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-08-12 Thread Francesco Romani
- Original Message - > From: "Richard W.M. Jones" > To: "Li Wei" > Cc: "Francesco Romani" , libvir-list@redhat.com > Sent: Tuesday, August 12, 2014 11:04:05 AM > Subject: Re: [libvirt] [RFC][scale] new API for querying domains stats >

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-08-12 Thread Richard W.M. Jones
On Tue, Aug 05, 2014 at 01:36:02PM +0800, Li Wei wrote: > Hi Richard, > > Thanks for your comment! > > On 08/04/2014 04:39 PM, Richard W.M. Jones wrote: > > On Mon, Aug 04, 2014 at 11:38:41AM +0800, Li Wei wrote: > >> Hi, > >> > >> On 07/22/2014 03:25 PM, Richard W.M. Jones wrote: > >>> > >>> Did

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-08-11 Thread Li Wei
ping ... On 08/05/2014 01:36 PM, Li Wei wrote: > Hi Richard, > > Thanks for your comment! > > On 08/04/2014 04:39 PM, Richard W.M. Jones wrote: >> On Mon, Aug 04, 2014 at 11:38:41AM +0800, Li Wei wrote: >>> Hi, >>> >>> On 07/22/2014 03:25 PM, Richard W.M. Jones wrote: Did anything come

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-08-05 Thread Eric Blake
On 08/04/2014 11:46 PM, Li Wei wrote: >> >> How about the following API: >> >> int virConnectGetAllBlockStats(virConnectPtr conn, >> virDomainPtr domain, >> virDomainBlockBulkStatsPtr *stats, >> unsigned int fla

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-08-04 Thread Li Wei
On 08/05/2014 01:36 PM, Li Wei wrote: > Hi Richard, > > Thanks for your comment! > > On 08/04/2014 04:39 PM, Richard W.M. Jones wrote: >> On Mon, Aug 04, 2014 at 11:38:41AM +0800, Li Wei wrote: >>> Hi, >>> >>> On 07/22/2014 03:25 PM, Richard W.M. Jones wrote: Did anything come of this

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-08-04 Thread Li Wei
Hi Richard, Thanks for your comment! On 08/04/2014 04:39 PM, Richard W.M. Jones wrote: > On Mon, Aug 04, 2014 at 11:38:41AM +0800, Li Wei wrote: >> Hi, >> >> On 07/22/2014 03:25 PM, Richard W.M. Jones wrote: >>> >>> Did anything come of this discussion, and/or is someone working on this? >> >> I

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-08-04 Thread Richard W.M. Jones
On Mon, Aug 04, 2014 at 11:38:41AM +0800, Li Wei wrote: > Hi, > > On 07/22/2014 03:25 PM, Richard W.M. Jones wrote: > > > > Did anything come of this discussion, and/or is someone working on this? > > I am working on an API to query block stats in a bulk style and proposed an > API as follow: >

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-08-03 Thread Li Wei
Hi, On 07/22/2014 03:25 PM, Richard W.M. Jones wrote: > > Did anything come of this discussion, and/or is someone working on this? I am working on an API to query block stats in a bulk style and proposed an API as follow: virDomainBlockStatsBulkFlags(virDomainPtr dom,

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-22 Thread Richard W.M. Jones
Did anything come of this discussion, and/or is someone working on this? Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming and virtualization blog: http://rwmj.wordpress.com virt-top is 'top' for virtual machines. Tiny program with many

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-09 Thread Daniel P. Berrange
On Wed, Jul 09, 2014 at 06:14:12AM -0400, Francesco Romani wrote: > > > - Original Message - > > From: "Francesco Romani" > > To: libvir-list@redhat.com > > Sent: Friday, July 4, 2014 6:44:07 PM > > Subject: Re: [libvirt] [RFC

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-09 Thread Francesco Romani
- Original Message - > From: "Francesco Romani" > To: libvir-list@redhat.com > Sent: Friday, July 4, 2014 6:44:07 PM > Subject: Re: [libvirt] [RFC][scale] new API for querying domains stats > > > However, a question here about bulk APIs. > > > On

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-04 Thread Francesco Romani
- Original Message - > From: "Daniel P. Berrange" > To: "Francesco Romani" > Cc: libvir-list@redhat.com, "Richard W.M. Jones" > Sent: Friday, July 4, 2014 6:21:30 PM > Subject: Re: [libvirt] [RFC][scale] new API for querying domains stats

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-04 Thread Daniel P. Berrange
14 1:39:57 PM > > Subject: Re: [libvirt] [RFC][scale] new API for querying domains stats > > > > > What would help for us: > > > > > > > > - A way to get information for multiple objects in a single domain > > > > > > > > - A

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-04 Thread Francesco Romani
- Original Message - > From: "Richard W.M. Jones" > To: "Daniel P. Berrange" > Cc: libvir-list@redhat.com, "Francesco Romani" > Sent: Friday, July 4, 2014 1:39:57 PM > Subject: Re: [libvirt] [RFC][scale] new API for querying domains stats &g

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-04 Thread Richard W.M. Jones
On Fri, Jul 04, 2014 at 12:33:27PM +0100, Daniel P. Berrange wrote: > On Fri, Jul 04, 2014 at 12:11:54PM +0100, Richard W.M. Jones wrote: > > On Tue, Jul 01, 2014 at 03:09:13AM -0400, Francesco Romani wrote: > > > I'd like to discuss possible APIs and plans for new query APIs in libvirt. > > > > >

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-04 Thread Daniel P. Berrange
On Fri, Jul 04, 2014 at 12:11:54PM +0100, Richard W.M. Jones wrote: > On Tue, Jul 01, 2014 at 03:09:13AM -0400, Francesco Romani wrote: > > I'd like to discuss possible APIs and plans for new query APIs in libvirt. > > > > I'm one of the oVirt (http://www.ovirt.org) developers, and I write code >

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-04 Thread Daniel P. Berrange
On Fri, Jul 04, 2014 at 12:14:06PM +0100, Richard W.M. Jones wrote: > > On Tue, Jul 01, 2014 at 09:35:21AM +0100, Daniel P. Berrange wrote: > > For the async API design, I could see two potential designs > > > > 1. A custom callback to run per API > > > > typedef (void)(*virDomainBlockInfoC

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-04 Thread Francesco Romani
- Original Message - > From: "Richard W.M. Jones" > To: "Francesco Romani" > Cc: libvir-list@redhat.com > Sent: Friday, July 4, 2014 1:11:54 PM > Subject: Re: [libvirt] [RFC][scale] new API for querying domains stats > > Right now we aim for a nu

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-04 Thread Richard W.M. Jones
On Tue, Jul 01, 2014 at 09:35:21AM +0100, Daniel P. Berrange wrote: > For the async API design, I could see two potential designs > > 1. A custom callback to run per API > > typedef (void)(*virDomainBlockInfoCallback)(virDomainPtr dom, > bool

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-04 Thread Richard W.M. Jones
On Tue, Jul 01, 2014 at 03:09:13AM -0400, Francesco Romani wrote: > I'd like to discuss possible APIs and plans for new query APIs in libvirt. > > I'm one of the oVirt (http://www.ovirt.org) developers, and I write code for > VDSM; > VDSM is the node management daemon, which is in charge, among m

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-04 Thread Daniel P. Berrange
On Thu, Jul 03, 2014 at 01:49:41PM -0600, Eric Blake wrote: > On 07/01/2014 03:33 AM, Daniel P. Berrange wrote: > > > 1. Time to write() the RPC call to the socket > > 2. Time for libvirtd to process the RPC call > > 3. Time to recv() the RPC reply from the socket > > ...and so on.. > > > > I

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-03 Thread Eric Blake
On 07/01/2014 03:33 AM, Daniel P. Berrange wrote: > 1. Time to write() the RPC call to the socket > 2. Time for libvirtd to process the RPC call > 3. Time to recv() the RPC reply from the socket > ...and so on.. > > If the time for item 2 dominates over the time for items 1 & 2 (which > it sh

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-03 Thread Eric Blake
On 07/01/2014 02:35 AM, Daniel P. Berrange wrote: > 1. A custom callback to run per API > > typedef (void)(*virDomainBlockInfoCallback)(virDomainPtr dom, > bool isError, > virDomainBlockInfoPtr

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-02 Thread Daniel P. Berrange
On Wed, Jul 02, 2014 at 11:56:23AM -0400, Francesco Romani wrote: > > > This is made only worse by the fact that VDSM is a python 2.7 application, > > > and notoriously > > > python 2.x behaves very badly with threads. We are already working to > > > improve our code, > > > but I'd like to bring th

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-02 Thread Francesco Romani
- Original Message - > From: "Michal Privoznik" > To: "Francesco Romani" , libvir-list@redhat.com > Sent: Tuesday, July 1, 2014 11:19:04 AM > Subject: Re: [libvirt] [RFC][scale] new API for querying domains stats > > Right now we aim for a number of

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-02 Thread Francesco Romani
- Original Message - > From: "Daniel P. Berrange" > To: "Francesco Romani" > Cc: libvir-list@redhat.com > Sent: Tuesday, July 1, 2014 10:35:21 AM > Subject: Re: [libvirt] [RFC][scale] new API for querying domains stats > [...] > > We [in VDS

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-01 Thread Michal Privoznik
On 01.07.2014 11:33, Daniel P. Berrange wrote: On Tue, Jul 01, 2014 at 11:19:04AM +0200, Michal Privoznik wrote: On 01.07.2014 09:09, Francesco Romani wrote: Hi everyone, I'd like to discuss possible APIs and plans for new query APIs in libvirt. I'm one of the oVirt (http://www.ovirt.org) dev

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-01 Thread Daniel P. Berrange
On Tue, Jul 01, 2014 at 11:19:04AM +0200, Michal Privoznik wrote: > On 01.07.2014 09:09, Francesco Romani wrote: > >Hi everyone, > > > >I'd like to discuss possible APIs and plans for new query APIs in libvirt. > > > >I'm one of the oVirt (http://www.ovirt.org) developers, and I write code for > >

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-01 Thread Michal Privoznik
On 01.07.2014 09:09, Francesco Romani wrote: Hi everyone, I'd like to discuss possible APIs and plans for new query APIs in libvirt. I'm one of the oVirt (http://www.ovirt.org) developers, and I write code for VDSM; VDSM is the node management daemon, which is in charge, among many other thin

Re: [libvirt] [RFC][scale] new API for querying domains stats

2014-07-01 Thread Daniel P. Berrange
On Tue, Jul 01, 2014 at 03:09:13AM -0400, Francesco Romani wrote: > Hi everyone, > > I'd like to discuss possible APIs and plans for new query APIs in libvirt. > > I'm one of the oVirt (http://www.ovirt.org) developers, and I write code for > VDSM; > VDSM is the node management daemon, which is

[libvirt] [RFC][scale] new API for querying domains stats

2014-07-01 Thread Francesco Romani
Hi everyone, I'd like to discuss possible APIs and plans for new query APIs in libvirt. I'm one of the oVirt (http://www.ovirt.org) developers, and I write code for VDSM; VDSM is the node management daemon, which is in charge, among many other things, to gather the host and statistics per Domai