Re: Dynamic scaling support for KVM

2019-09-12 Thread Wei ZHOU
Totally agree with Andrija.

-Wei

On Thu, 12 Sep 2019 at 17:41, Andrija Panic  wrote:

> Guys,
>
> My 2 cents:
>
> I've played with dynamically increasing CPU number and RAM memory size
> across all 3 hypervisors (during my analysis of how currently cpu/ram
> overprovisioning works, in order to see the feasibility of dynamic
> overprovisioning i.e. do any changes (reductions in cpu/ram) that we
> already do after the VM is stopped and started - this dynamic apply of
> overprovisioning is not a subject atm, just mentioning it for sake of
> completeness.
>
> Balloning driver is officially an abandoned project (I explicitly pinged an
> RH engineer to confirm what they stated on the balooning driver home
> page...), so dynamically scalling down ram for KVM is not possible to be
> done in the graceful maner. That beings said, you can still just blindly
> reduce amount of ram (and cause kernel panics and such).
>
> Atm, we support dynamic scalling UP only, for XS and VMware - idea is that
> we support the same for KVM - to be able to change Compute Offering to a
> bigger one, on the fly.
> This is possible with minor changes in XML, ad Rohit stated already and a
> simple call to libvirt (i..e.virsh).
>
> From my point of view, we are not considering any special use cases etc, we
> simply want to allow upgrading Compute Offering on the fly.
>
> Does this makes sense, any feedback?
>
> Cheers
>
>
>
> On Thu, Sep 12, 2019, 02:16 Riepl, Gregor (SWISS TXT) <
> gregor.ri...@swisstxt.ch> wrote:
>
> > > Just to add some context, this was awhile back that I tried it,
> > > years. The idea was that we could just set max memory to some crazy
> > > high number and then “unlock” just the amount in the offering, and
> > > adjust on the fly. As mentioned I found it was trivial for VM users
> > > to unlock the full amount and get a “free” upgrade, so it was
> > > useless. There was also a non trivial amount of RAM overhead just
> > > lost to support balloon, if I recall.
> >
> > IMHO, supporting full dynamic scaling included shrinkage has a limited
> > number of use cases. If you want a workload to be dynamically scalable,
> > it would usually be much better to look into horizontal scaling, i.e.
> > deploying more instances as load increases. If your workload is too
> > small to make horizontal scaling effective, you should probably ask
> > yourself the question if you need scaling at all.
> >
> > Limiting scaling to memory increase only might have some merit and
> > should be much easier to implement by means of memory hotplug
> > emulation. Though, is it really worth the complexity when an offline
> > upgrade would normally only cause a very short downtime (or none at all
> > in a HA setup)?
> >
> >
>


Re: Dynamic scaling support for KVM

2019-09-12 Thread Sven Vogel
I agree with Andrija.

Von meinem iPhone gesendet


__

Sven Vogel
Teamlead Platform

EWERK DIGITAL GmbH
Brühl 24, D-04109 Leipzig
P +49 341 42649 - 99
F +49 341 42649 - 98
s.vo...@ewerk.com
www.ewerk.com

Geschäftsführer:
Dr. Erik Wende, Hendrik Schubert, Frank Richter
Registergericht: Leipzig HRB 9065

Zertifiziert nach:
ISO/IEC 27001:2013
DIN EN ISO 9001:2015
DIN ISO/IEC 2-1:2011

EWERK-Blog | LinkedIn | Xing | Twitter | Facebook

Auskünfte und Angebote per Mail sind freibleibend und unverbindlich.

Disclaimer Privacy:
Der Inhalt dieser E-Mail (einschließlich etwaiger beigefügter Dateien) ist 
vertraulich und nur für den Empfänger bestimmt. Sollten Sie nicht der 
bestimmungsgemäße Empfänger sein, ist Ihnen jegliche Offenlegung, 
Vervielfältigung, Weitergabe oder Nutzung des Inhalts untersagt. Bitte 
informieren Sie in diesem Fall unverzüglich den Absender und löschen Sie die 
E-Mail (einschließlich etwaiger beigefügter Dateien) von Ihrem System. Vielen 
Dank.

The contents of this e-mail (including any attachments) are confidential and 
may be legally privileged. If you are not the intended recipient of this 
e-mail, any disclosure, copying, distribution or use of its contents is 
strictly prohibited, and you should please notify the sender immediately and 
then delete it (including any attachments) from your system. Thank you.
> Am 12.09.2019 um 17:41 schrieb Andrija Panic :
>
> Guys,
>
> My 2 cents:
>
> I've played with dynamically increasing CPU number and RAM memory size
> across all 3 hypervisors (during my analysis of how currently cpu/ram
> overprovisioning works, in order to see the feasibility of dynamic
> overprovisioning i.e. do any changes (reductions in cpu/ram) that we
> already do after the VM is stopped and started - this dynamic apply of
> overprovisioning is not a subject atm, just mentioning it for sake of
> completeness.
>
> Balloning driver is officially an abandoned project (I explicitly pinged an
> RH engineer to confirm what they stated on the balooning driver home
> page...), so dynamically scalling down ram for KVM is not possible to be
> done in the graceful maner. That beings said, you can still just blindly
> reduce amount of ram (and cause kernel panics and such).
>
> Atm, we support dynamic scalling UP only, for XS and VMware - idea is that
> we support the same for KVM - to be able to change Compute Offering to a
> bigger one, on the fly.
> This is possible with minor changes in XML, ad Rohit stated already and a
> simple call to libvirt (i..e.virsh).
>
> From my point of view, we are not considering any special use cases etc, we
> simply want to allow upgrading Compute Offering on the fly.
>
> Does this makes sense, any feedback?
>
> Cheers
>
>
>
> On Thu, Sep 12, 2019, 02:16 Riepl, Gregor (SWISS TXT) <
> gregor.ri...@swisstxt.ch> wrote:
>
>>> Just to add some context, this was awhile back that I tried it,
>>> years. The idea was that we could just set max memory to some crazy
>>> high number and then “unlock” just the amount in the offering, and
>>> adjust on the fly. As mentioned I found it was trivial for VM users
>>> to unlock the full amount and get a “free” upgrade, so it was
>>> useless. There was also a non trivial amount of RAM overhead just
>>> lost to support balloon, if I recall.
>>
>> IMHO, supporting full dynamic scaling included shrinkage has a limited
>> number of use cases. If you want a workload to be dynamically scalable,
>> it would usually be much better to look into horizontal scaling, i.e.
>> deploying more instances as load increases. If your workload is too
>> small to make horizontal scaling effective, you should probably ask
>> yourself the question if you need scaling at all.
>>
>> Limiting scaling to memory increase only might have some merit and
>> should be much easier to implement by means of memory hotplug
>> emulation. Though, is it really worth the complexity when an offline
>> upgrade would normally only cause a very short downtime (or none at all
>> in a HA setup)?
>>
>>


Re: Dynamic scaling support for KVM

2019-09-12 Thread Andrija Panic
Guys,

My 2 cents:

I've played with dynamically increasing CPU number and RAM memory size
across all 3 hypervisors (during my analysis of how currently cpu/ram
overprovisioning works, in order to see the feasibility of dynamic
overprovisioning i.e. do any changes (reductions in cpu/ram) that we
already do after the VM is stopped and started - this dynamic apply of
overprovisioning is not a subject atm, just mentioning it for sake of
completeness.

Balloning driver is officially an abandoned project (I explicitly pinged an
RH engineer to confirm what they stated on the balooning driver home
page...), so dynamically scalling down ram for KVM is not possible to be
done in the graceful maner. That beings said, you can still just blindly
reduce amount of ram (and cause kernel panics and such).

Atm, we support dynamic scalling UP only, for XS and VMware - idea is that
we support the same for KVM - to be able to change Compute Offering to a
bigger one, on the fly.
This is possible with minor changes in XML, ad Rohit stated already and a
simple call to libvirt (i..e.virsh).

>From my point of view, we are not considering any special use cases etc, we
simply want to allow upgrading Compute Offering on the fly.

Does this makes sense, any feedback?

Cheers



On Thu, Sep 12, 2019, 02:16 Riepl, Gregor (SWISS TXT) <
gregor.ri...@swisstxt.ch> wrote:

> > Just to add some context, this was awhile back that I tried it,
> > years. The idea was that we could just set max memory to some crazy
> > high number and then “unlock” just the amount in the offering, and
> > adjust on the fly. As mentioned I found it was trivial for VM users
> > to unlock the full amount and get a “free” upgrade, so it was
> > useless. There was also a non trivial amount of RAM overhead just
> > lost to support balloon, if I recall.
>
> IMHO, supporting full dynamic scaling included shrinkage has a limited
> number of use cases. If you want a workload to be dynamically scalable,
> it would usually be much better to look into horizontal scaling, i.e.
> deploying more instances as load increases. If your workload is too
> small to make horizontal scaling effective, you should probably ask
> yourself the question if you need scaling at all.
>
> Limiting scaling to memory increase only might have some merit and
> should be much easier to implement by means of memory hotplug
> emulation. Though, is it really worth the complexity when an offline
> upgrade would normally only cause a very short downtime (or none at all
> in a HA setup)?
>
>


Re: Dynamic scaling support for KVM

2019-09-12 Thread Riepl, Gregor (SWISS TXT)
> Just to add some context, this was awhile back that I tried it,
> years. The idea was that we could just set max memory to some crazy
> high number and then “unlock” just the amount in the offering, and
> adjust on the fly. As mentioned I found it was trivial for VM users
> to unlock the full amount and get a “free” upgrade, so it was
> useless. There was also a non trivial amount of RAM overhead just
> lost to support balloon, if I recall.

IMHO, supporting full dynamic scaling included shrinkage has a limited
number of use cases. If you want a workload to be dynamically scalable,
it would usually be much better to look into horizontal scaling, i.e.
deploying more instances as load increases. If your workload is too
small to make horizontal scaling effective, you should probably ask
yourself the question if you need scaling at all.

Limiting scaling to memory increase only might have some merit and
should be much easier to implement by means of memory hotplug
emulation. Though, is it really worth the complexity when an offline
upgrade would normally only cause a very short downtime (or none at all
in a HA setup)?



Re: Dynamic scaling support for KVM

2019-09-12 Thread Marcus
Just to add some context, this was awhile back that I tried it, years. The
idea was that we could just set max memory to some crazy high number and
then “unlock” just the amount in the offering, and adjust on the fly. As
mentioned I found it was trivial for VM users to unlock the full amount and
get a “free” upgrade, so it was useless. There was also a non trivial
amount of RAM overhead just lost to support balloon, if I recall.

It’s possible balloon could be useful for some “trusted workload”
situations, internal use, etc. however I have just gotten the impression
over the years that not many are satisfied with ballooning in general.

I’d be curious to understand the cpu autoscaling use cases. My first
thought was that if you want a VM that will only use one core when idle and
use eight or more cores when busy, it will already do that if you just size
to max. Is there a scheduling/allocation/DRS angle here, or a cgroup/shares
scaling angle, or something else? Maybe a billing angle, maybe we want to
allow people to “give back” and only pay for a certain number of cores at
any given moment, rather than doing a cpu util % billing model?

 I’ve heard of people wanting to spin up more instances based on load
balancer data, but traditionally not much demand for shrinking/growing CPU
and memory, except maybe in the DRS case where it is combined with being
able to shuffle workloads across physical resources.

On Wednesday, September 11, 2019, Marcus  wrote:

> Yes, it puts memory pressure within the VM to evict the memory and then it
> is hidden from the OS.
>
> However, I’m not a fan of ballooning, as it depends on a driver in the
> guest OS. When I tested it a few years back one simply had to blacklist the
> module within the VM to get the full (max) RAM, as the driver’s job is to
> hide the difference from the guest kernel. Therefore it wasn’t very useful
> as a means of providing tiered offerings that could be changed on the fly.
>
> I haven’t played with this in awhile though, so perhaps we are
> seeing/working toward true memory hotplug now.
>
> On Wednesday, September 11, 2019, Rohit Yadav 
> wrote:
>
>> Hi Andrija,
>>
>> I tried scaling down memory, it worked on my test VM. I don't think it
>> should cause VM or apps to crash if libvirt allows.
>>
>> Regards.
>>
>> Regards,
>> Rohit Yadav
>>
>> ____
>> From: Andrija Panic 
>> Sent: Wednesday, September 11, 2019 2:11:22 PM
>> To: dev 
>> Subject: Re: Dynamic scaling support for KVM
>>
>> Correct Rohit - but we will not support scaling down the MEM (nor CPU),
>> since OS will crash, since there is no working ballooning driver (you need
>> to use ballooning device (check) and the driver inside OS - which is an
>> abandoned project - I have pinged an RHEL engineer for this, and he
>> explicitly confirmed).
>>
>> So same scale-up as we do with VMware and XenServer - very simple to
>> implement I guess. One thing to notice, per my tresting (would be good to
>> confirm) - balooning device is automatically injected in the XML of a VM
>> when RAM overprovisioning factor is set (which hopefully no one will do) -
>> so we just need to inject the balooning device perhaps in every VM -
>> again,
>> to be checked.
>>
>> On Wed, 11 Sep 2019 at 12:31, Fariborz Navidan 
>> wrote:
>>
>> > I hope this features is implemented in near future.
>> >
>> > Regards
>> >
>> > On Wed, Sep 11, 2019 at 11:53 PM Rohit Yadav > >
>> > wrote:
>> >
>> > > I tried this:
>> > >
>> > > The domain XML needs to say what is the current allocation of vcpus or
>> > > memory and what is the max. value:
>> > >   8392704
>> > >   4194304
>> > >   4
>> > >
>> > > Then, using virsh I could dynamically scale/up/down the vcpus and
>> memory:
>> > > virsh setmem  6G
>> > > virsh setvcpus  4
>> > >
>> > > This changed the value in domain XML for the currentMemory and current
>> > > value in vcpu xml node.
>> > >
>> > > The current scaling feature allows changing a compute/service
>> offering.
>> > > Using virsh, we can set the max cpus and memory (using setmaxmem and
>> > > setvcpus), so the implementation can run the equivalent in domain xml
>> > edit
>> > > while applying the changes comput offering. I don't think any change
>> in
>> > > offerings or db/schema is necessary.
>> > >
>> > >
>> > > Regards,
>> > >
>> > > Rohit Yadav
>> > >

Re: Dynamic scaling support for KVM

2019-09-11 Thread Marcus
Yes, it puts memory pressure within the VM to evict the memory and then it
is hidden from the OS.

However, I’m not a fan of ballooning, as it depends on a driver in the
guest OS. When I tested it a few years back one simply had to blacklist the
module within the VM to get the full (max) RAM, as the driver’s job is to
hide the difference from the guest kernel. Therefore it wasn’t very useful
as a means of providing tiered offerings that could be changed on the fly.

I haven’t played with this in awhile though, so perhaps we are
seeing/working toward true memory hotplug now.

On Wednesday, September 11, 2019, Rohit Yadav 
wrote:

> Hi Andrija,
>
> I tried scaling down memory, it worked on my test VM. I don't think it
> should cause VM or apps to crash if libvirt allows.
>
> Regards.
>
> Regards,
> Rohit Yadav
>
> 
> From: Andrija Panic 
> Sent: Wednesday, September 11, 2019 2:11:22 PM
> To: dev 
> Subject: Re: Dynamic scaling support for KVM
>
> Correct Rohit - but we will not support scaling down the MEM (nor CPU),
> since OS will crash, since there is no working ballooning driver (you need
> to use ballooning device (check) and the driver inside OS - which is an
> abandoned project - I have pinged an RHEL engineer for this, and he
> explicitly confirmed).
>
> So same scale-up as we do with VMware and XenServer - very simple to
> implement I guess. One thing to notice, per my tresting (would be good to
> confirm) - balooning device is automatically injected in the XML of a VM
> when RAM overprovisioning factor is set (which hopefully no one will do) -
> so we just need to inject the balooning device perhaps in every VM - again,
> to be checked.
>
> On Wed, 11 Sep 2019 at 12:31, Fariborz Navidan 
> wrote:
>
> > I hope this features is implemented in near future.
> >
> > Regards
> >
> > On Wed, Sep 11, 2019 at 11:53 PM Rohit Yadav 
> > wrote:
> >
> > > I tried this:
> > >
> > > The domain XML needs to say what is the current allocation of vcpus or
> > > memory and what is the max. value:
> > >   8392704
> > >   4194304
> > >   4
> > >
> > > Then, using virsh I could dynamically scale/up/down the vcpus and
> memory:
> > > virsh setmem  6G
> > > virsh setvcpus  4
> > >
> > > This changed the value in domain XML for the currentMemory and current
> > > value in vcpu xml node.
> > >
> > > The current scaling feature allows changing a compute/service offering.
> > > Using virsh, we can set the max cpus and memory (using setmaxmem and
> > > setvcpus), so the implementation can run the equivalent in domain xml
> > edit
> > > while applying the changes comput offering. I don't think any change in
> > > offerings or db/schema is necessary.
> > >
> > >
> > > Regards,
> > >
> > > Rohit Yadav
> > >
> > > Software Architect, ShapeBlue
> > >
> > > https://www.shapeblue.com
> > >
> > > ____
> > > From: Wei ZHOU 
> > > Sent: Thursday, August 15, 2019 16:37
> > > To: dev@cloudstack.apache.org 
> > > Subject: Re: Dynamic scaling support for KVM
> > >
> > > +1 in 4.14.
> > >
> > > -Wei
> > >
> > >
> > >
> > > Fariborz Navidan  于2019年8月8日周四 下午2:27写道:
> > >
> > > > Hello Devs,
> > > >
> > > > Since long time ago libvirt supports live horizental scaling of VMs.
> Do
> > > you
> > > > intend for ACS 4.13 to support dynamic scaling of KVM VMs?
> > > >
> > > > TIA
> > > >
> > >
> > > rohit.ya...@shapeblue.com
> > > www.shapeblue.com<http://www.shapeblue.com>
> > > Amadeus House, Floral Street, London  WC2E 9DPUK
> > > @shapeblue
> > >
> > >
> > >
> > >
> >
>
>
> --
>
> Andrija Panić
>
> rohit.ya...@shapeblue.com
> www.shapeblue.com
> Amadeus House, Floral Street, London  WC2E 9DPUK
> @shapeblue
>
>
>
>


Re: Dynamic scaling support for KVM

2019-09-11 Thread Rohit Yadav
Hi Andrija,

I tried scaling down memory, it worked on my test VM. I don't think it should 
cause VM or apps to crash if libvirt allows.

Regards.

Regards,
Rohit Yadav


From: Andrija Panic 
Sent: Wednesday, September 11, 2019 2:11:22 PM
To: dev 
Subject: Re: Dynamic scaling support for KVM

Correct Rohit - but we will not support scaling down the MEM (nor CPU),
since OS will crash, since there is no working ballooning driver (you need
to use ballooning device (check) and the driver inside OS - which is an
abandoned project - I have pinged an RHEL engineer for this, and he
explicitly confirmed).

So same scale-up as we do with VMware and XenServer - very simple to
implement I guess. One thing to notice, per my tresting (would be good to
confirm) - balooning device is automatically injected in the XML of a VM
when RAM overprovisioning factor is set (which hopefully no one will do) -
so we just need to inject the balooning device perhaps in every VM - again,
to be checked.

On Wed, 11 Sep 2019 at 12:31, Fariborz Navidan 
wrote:

> I hope this features is implemented in near future.
>
> Regards
>
> On Wed, Sep 11, 2019 at 11:53 PM Rohit Yadav 
> wrote:
>
> > I tried this:
> >
> > The domain XML needs to say what is the current allocation of vcpus or
> > memory and what is the max. value:
> >   8392704
> >   4194304
> >   4
> >
> > Then, using virsh I could dynamically scale/up/down the vcpus and memory:
> > virsh setmem  6G
> > virsh setvcpus  4
> >
> > This changed the value in domain XML for the currentMemory and current
> > value in vcpu xml node.
> >
> > The current scaling feature allows changing a compute/service offering.
> > Using virsh, we can set the max cpus and memory (using setmaxmem and
> > setvcpus), so the implementation can run the equivalent in domain xml
> edit
> > while applying the changes comput offering. I don't think any change in
> > offerings or db/schema is necessary.
> >
> >
> > Regards,
> >
> > Rohit Yadav
> >
> > Software Architect, ShapeBlue
> >
> > https://www.shapeblue.com
> >
> > 
> > From: Wei ZHOU 
> > Sent: Thursday, August 15, 2019 16:37
> > To: dev@cloudstack.apache.org 
> > Subject: Re: Dynamic scaling support for KVM
> >
> > +1 in 4.14.
> >
> > -Wei
> >
> >
> >
> > Fariborz Navidan  于2019年8月8日周四 下午2:27写道:
> >
> > > Hello Devs,
> > >
> > > Since long time ago libvirt supports live horizental scaling of VMs. Do
> > you
> > > intend for ACS 4.13 to support dynamic scaling of KVM VMs?
> > >
> > > TIA
> > >
> >
> > rohit.ya...@shapeblue.com
> > www.shapeblue.com<http://www.shapeblue.com>
> > Amadeus House, Floral Street, London  WC2E 9DPUK
> > @shapeblue
> >
> >
> >
> >
>


--

Andrija Panić

rohit.ya...@shapeblue.com 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue
  
 



Re: Dynamic scaling support for KVM

2019-09-11 Thread Nicolas Vazquez
I've created a work-in-progress PR for this: 
https://github.com/apache/cloudstack/pull/3595


Regards,

Nicolas Vazquez


From: Andrija Panic 
Sent: Wednesday, September 11, 2019 6:11 PM
To: dev 
Subject: Re: Dynamic scaling support for KVM

Correct Rohit - but we will not support scaling down the MEM (nor CPU),
since OS will crash, since there is no working ballooning driver (you need
to use ballooning device (check) and the driver inside OS - which is an
abandoned project - I have pinged an RHEL engineer for this, and he
explicitly confirmed).

So same scale-up as we do with VMware and XenServer - very simple to
implement I guess. One thing to notice, per my tresting (would be good to
confirm) - balooning device is automatically injected in the XML of a VM
when RAM overprovisioning factor is set (which hopefully no one will do) -
so we just need to inject the balooning device perhaps in every VM - again,
to be checked.

On Wed, 11 Sep 2019 at 12:31, Fariborz Navidan 
wrote:

> I hope this features is implemented in near future.
>
> Regards
>
> On Wed, Sep 11, 2019 at 11:53 PM Rohit Yadav 
> wrote:
>
> > I tried this:
> >
> > The domain XML needs to say what is the current allocation of vcpus or
> > memory and what is the max. value:
> >   8392704
> >   4194304
> >   4
> >
> > Then, using virsh I could dynamically scale/up/down the vcpus and memory:
> > virsh setmem  6G
> > virsh setvcpus  4
> >
> > This changed the value in domain XML for the currentMemory and current
> > value in vcpu xml node.
> >
> > The current scaling feature allows changing a compute/service offering.
> > Using virsh, we can set the max cpus and memory (using setmaxmem and
> > setvcpus), so the implementation can run the equivalent in domain xml
> edit
> > while applying the changes comput offering. I don't think any change in
> > offerings or db/schema is necessary.
> >
> >
> > Regards,
> >
> > Rohit Yadav
> >
> > Software Architect, ShapeBlue
> >
> > https://www.shapeblue.com
> >
> > 
> > From: Wei ZHOU 
> > Sent: Thursday, August 15, 2019 16:37
> > To: dev@cloudstack.apache.org 
> > Subject: Re: Dynamic scaling support for KVM
> >
> > +1 in 4.14.
> >
> > -Wei
> >
> >
> >
> > Fariborz Navidan  于2019年8月8日周四 下午2:27写道:
> >
> > > Hello Devs,
> > >
> > > Since long time ago libvirt supports live horizental scaling of VMs. Do
> > you
> > > intend for ACS 4.13 to support dynamic scaling of KVM VMs?
> > >
> > > TIA
> > >
> >
> > rohit.ya...@shapeblue.com
> > www.shapeblue.com<http://www.shapeblue.com>
> > Amadeus House, Floral Street, London  WC2E 9DPUK
> > @shapeblue
> >
> >
> >
> >
>


--

Andrija Panić

nicolas.vazq...@shapeblue.com 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue
  
 



Re: Dynamic scaling support for KVM

2019-09-11 Thread Andrija Panic
Correct Rohit - but we will not support scaling down the MEM (nor CPU),
since OS will crash, since there is no working ballooning driver (you need
to use ballooning device (check) and the driver inside OS - which is an
abandoned project - I have pinged an RHEL engineer for this, and he
explicitly confirmed).

So same scale-up as we do with VMware and XenServer - very simple to
implement I guess. One thing to notice, per my tresting (would be good to
confirm) - balooning device is automatically injected in the XML of a VM
when RAM overprovisioning factor is set (which hopefully no one will do) -
so we just need to inject the balooning device perhaps in every VM - again,
to be checked.

On Wed, 11 Sep 2019 at 12:31, Fariborz Navidan 
wrote:

> I hope this features is implemented in near future.
>
> Regards
>
> On Wed, Sep 11, 2019 at 11:53 PM Rohit Yadav 
> wrote:
>
> > I tried this:
> >
> > The domain XML needs to say what is the current allocation of vcpus or
> > memory and what is the max. value:
> >   8392704
> >   4194304
> >   4
> >
> > Then, using virsh I could dynamically scale/up/down the vcpus and memory:
> > virsh setmem  6G
> > virsh setvcpus  4
> >
> > This changed the value in domain XML for the currentMemory and current
> > value in vcpu xml node.
> >
> > The current scaling feature allows changing a compute/service offering.
> > Using virsh, we can set the max cpus and memory (using setmaxmem and
> > setvcpus), so the implementation can run the equivalent in domain xml
> edit
> > while applying the changes comput offering. I don't think any change in
> > offerings or db/schema is necessary.
> >
> >
> > Regards,
> >
> > Rohit Yadav
> >
> > Software Architect, ShapeBlue
> >
> > https://www.shapeblue.com
> >
> > 
> > From: Wei ZHOU 
> > Sent: Thursday, August 15, 2019 16:37
> > To: dev@cloudstack.apache.org 
> > Subject: Re: Dynamic scaling support for KVM
> >
> > +1 in 4.14.
> >
> > -Wei
> >
> >
> >
> > Fariborz Navidan  于2019年8月8日周四 下午2:27写道:
> >
> > > Hello Devs,
> > >
> > > Since long time ago libvirt supports live horizental scaling of VMs. Do
> > you
> > > intend for ACS 4.13 to support dynamic scaling of KVM VMs?
> > >
> > > TIA
> > >
> >
> > rohit.ya...@shapeblue.com
> > www.shapeblue.com
> > Amadeus House, Floral Street, London  WC2E 9DPUK
> > @shapeblue
> >
> >
> >
> >
>


-- 

Andrija Panić


Re: Dynamic scaling support for KVM

2019-09-11 Thread Fariborz Navidan
I hope this features is implemented in near future.

Regards

On Wed, Sep 11, 2019 at 11:53 PM Rohit Yadav 
wrote:

> I tried this:
>
> The domain XML needs to say what is the current allocation of vcpus or
> memory and what is the max. value:
>   8392704
>   4194304
>   4
>
> Then, using virsh I could dynamically scale/up/down the vcpus and memory:
> virsh setmem  6G
> virsh setvcpus  4
>
> This changed the value in domain XML for the currentMemory and current
> value in vcpu xml node.
>
> The current scaling feature allows changing a compute/service offering.
> Using virsh, we can set the max cpus and memory (using setmaxmem and
> setvcpus), so the implementation can run the equivalent in domain xml edit
> while applying the changes comput offering. I don't think any change in
> offerings or db/schema is necessary.
>
>
> Regards,
>
> Rohit Yadav
>
> Software Architect, ShapeBlue
>
> https://www.shapeblue.com
>
> 
> From: Wei ZHOU 
> Sent: Thursday, August 15, 2019 16:37
> To: dev@cloudstack.apache.org 
> Subject: Re: Dynamic scaling support for KVM
>
> +1 in 4.14.
>
> -Wei
>
>
>
> Fariborz Navidan  于2019年8月8日周四 下午2:27写道:
>
> > Hello Devs,
> >
> > Since long time ago libvirt supports live horizental scaling of VMs. Do
> you
> > intend for ACS 4.13 to support dynamic scaling of KVM VMs?
> >
> > TIA
> >
>
> rohit.ya...@shapeblue.com
> www.shapeblue.com
> Amadeus House, Floral Street, London  WC2E 9DPUK
> @shapeblue
>
>
>
>


Re: Dynamic scaling support for KVM

2019-09-11 Thread Rohit Yadav
I tried this:

The domain XML needs to say what is the current allocation of vcpus or memory 
and what is the max. value:
  8392704
  4194304
  4

Then, using virsh I could dynamically scale/up/down the vcpus and memory:
virsh setmem  6G
virsh setvcpus  4

This changed the value in domain XML for the currentMemory and current value in 
vcpu xml node.

The current scaling feature allows changing a compute/service offering. Using 
virsh, we can set the max cpus and memory (using setmaxmem and setvcpus), so 
the implementation can run the equivalent in domain xml edit while applying the 
changes comput offering. I don't think any change in offerings or db/schema is 
necessary.


Regards,

Rohit Yadav

Software Architect, ShapeBlue

https://www.shapeblue.com


From: Wei ZHOU 
Sent: Thursday, August 15, 2019 16:37
To: dev@cloudstack.apache.org 
Subject: Re: Dynamic scaling support for KVM

+1 in 4.14.

-Wei



Fariborz Navidan  于2019年8月8日周四 下午2:27写道:

> Hello Devs,
>
> Since long time ago libvirt supports live horizental scaling of VMs. Do you
> intend for ACS 4.13 to support dynamic scaling of KVM VMs?
>
> TIA
>

rohit.ya...@shapeblue.com 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue
  
 



Re: Dynamic scaling support for KVM

2019-08-15 Thread Wei ZHOU
+1 in 4.14.

-Wei



Fariborz Navidan  于2019年8月8日周四 下午2:27写道:

> Hello Devs,
>
> Since long time ago libvirt supports live horizental scaling of VMs. Do you
> intend for ACS 4.13 to support dynamic scaling of KVM VMs?
>
> TIA
>


Re: Re:Re: Dynamic scaling support for KVM

2019-08-14 Thread Pavan Kumar Aravapalli
+1 to the feature.


Regards,

Pavan.


From: Haijiao <18602198...@163.com>
Sent: 09 August 2019 11:02:27
To: dev@cloudstack.apache.org 
Subject: Re:Re: Dynamic scaling support for KVM



+1,  almost a 'must-have' feature in nowdays.



At 2019-08-09 00:40:57, "Sven Vogel"  wrote:
>+1 from me too. I hope so with refactor or without :)
>
>Von meinem iPhone gesendet
>
>
>__
>
>Sven Vogel
>Teamlead Platform
>
>EWERK RZ GmbH
>Brühl 24, D-04109 Leipzig
>P +49 341 42649 - 11
>F +49 341 42649 - 18
>s.vo...@ewerk.com
>www.ewerk.com<http://www.ewerk.com>
>
>Geschäftsführer:
>Dr. Erik Wende, Hendrik Schubert, Frank Richter
>Registergericht: Leipzig HRB 17023
>
>Zertifiziert nach:
>ISO/IEC 27001:2013
>DIN EN ISO 9001:2015
>DIN ISO/IEC 2-1:2011
>
>EWERK-Blog | LinkedIn | Xing | Twitter | Facebook
>
>Auskünfte und Angebote per Mail sind freibleibend und unverbindlich.
>
>Disclaimer Privacy:
>Der Inhalt dieser E-Mail (einschließlich etwaiger beigefügter Dateien) ist 
>vertraulich und nur für den Empfänger bestimmt. Sollten Sie nicht der 
>bestimmungsgemäße Empfänger sein, ist Ihnen jegliche Offenlegung, 
>Vervielfältigung, Weitergabe oder Nutzung des Inhalts untersagt. Bitte 
>informieren Sie in diesem Fall unverzüglich den Absender und löschen Sie die 
>E-Mail (einschließlich etwaiger beigefügter Dateien) von Ihrem System. Vielen 
>Dank.
>
>The contents of this e-mail (including any attachments) are confidential and 
>may be legally privileged. If you are not the intended recipient of this 
>e-mail, any disclosure, copying, distribution or use of its contents is 
>strictly prohibited, and you should please notify the sender immediately and 
>then delete it (including any attachments) from your system. Thank you.
>> Am 08.08.2019 um 18:18 schrieb Anurag Awasthi :
>>
>> +1 to the feature.
>>
>> @Fariborz, perhaps open a github issue as a new feature request?
>> 
>> From: Simon Weller 
>> Sent: Thursday, August 8, 2019 6:30 PM
>> To: dev@cloudstack.apache.org 
>> Subject: Re: Dynamic scaling support for KVM
>>
>> Hi Fariboz,
>>
>> We'd definitely like to add that functionality, but it's going to be a 
>> fairly big lift, as the libxml configs are currently built as a single 
>> block. A large refactor of how we interact with libvirt will be required.
>> This is definitely something we have on our list and hopefully we can 
>> starting taking a look at it within the next few months.
>>
>> -Si
>> ____
>> From: Fariborz Navidan 
>> Sent: Thursday, August 8, 2019 7:27 AM
>> To: dev@cloudstack.apache.org 
>> Subject: Dynamic scaling support for KVM
>>
>> Hello Devs,
>>
>> Since long time ago libvirt supports live horizental scaling of VMs. Do you
>> intend for ACS 4.13 to support dynamic scaling of KVM VMs?
>>
>> TIA
>>
>> anurag.awas...@shapeblue.com
>> www.shapeblue.com<http://www.shapeblue.com>
>> Amadeus House, Floral Street, London  WC2E 9DPUK
>> @shapeblue
>>
>>
>>
DISCLAIMER
==
This e-mail may contain privileged and confidential information which is the 
property of Accelerite, a Persistent Systems business. It is intended only for 
the use of the individual or entity to which it is addressed. If you are not 
the intended recipient, you are not authorized to read, retain, copy, print, 
distribute or use this message. If you have received this communication in 
error, please notify the sender and delete all copies of this message. 
Accelerite, a Persistent Systems business does not accept any liability for 
virus infected mails.


Re:Re: Dynamic scaling support for KVM

2019-08-08 Thread Haijiao


+1,  almost a 'must-have' feature in nowdays. 



At 2019-08-09 00:40:57, "Sven Vogel"  wrote:
>+1 from me too. I hope so with refactor or without :)
>
>Von meinem iPhone gesendet
>
>
>__
>
>Sven Vogel
>Teamlead Platform
>
>EWERK RZ GmbH
>Brühl 24, D-04109 Leipzig
>P +49 341 42649 - 11
>F +49 341 42649 - 18
>s.vo...@ewerk.com
>www.ewerk.com
>
>Geschäftsführer:
>Dr. Erik Wende, Hendrik Schubert, Frank Richter
>Registergericht: Leipzig HRB 17023
>
>Zertifiziert nach:
>ISO/IEC 27001:2013
>DIN EN ISO 9001:2015
>DIN ISO/IEC 2-1:2011
>
>EWERK-Blog | LinkedIn | Xing | Twitter | Facebook
>
>Auskünfte und Angebote per Mail sind freibleibend und unverbindlich.
>
>Disclaimer Privacy:
>Der Inhalt dieser E-Mail (einschließlich etwaiger beigefügter Dateien) ist 
>vertraulich und nur für den Empfänger bestimmt. Sollten Sie nicht der 
>bestimmungsgemäße Empfänger sein, ist Ihnen jegliche Offenlegung, 
>Vervielfältigung, Weitergabe oder Nutzung des Inhalts untersagt. Bitte 
>informieren Sie in diesem Fall unverzüglich den Absender und löschen Sie die 
>E-Mail (einschließlich etwaiger beigefügter Dateien) von Ihrem System. Vielen 
>Dank.
>
>The contents of this e-mail (including any attachments) are confidential and 
>may be legally privileged. If you are not the intended recipient of this 
>e-mail, any disclosure, copying, distribution or use of its contents is 
>strictly prohibited, and you should please notify the sender immediately and 
>then delete it (including any attachments) from your system. Thank you.
>> Am 08.08.2019 um 18:18 schrieb Anurag Awasthi :
>>
>> +1 to the feature.
>>
>> @Fariborz, perhaps open a github issue as a new feature request?
>> ____
>> From: Simon Weller 
>> Sent: Thursday, August 8, 2019 6:30 PM
>> To: dev@cloudstack.apache.org 
>> Subject: Re: Dynamic scaling support for KVM
>>
>> Hi Fariboz,
>>
>> We'd definitely like to add that functionality, but it's going to be a 
>> fairly big lift, as the libxml configs are currently built as a single 
>> block. A large refactor of how we interact with libvirt will be required.
>> This is definitely something we have on our list and hopefully we can 
>> starting taking a look at it within the next few months.
>>
>> -Si
>> 
>> From: Fariborz Navidan 
>> Sent: Thursday, August 8, 2019 7:27 AM
>> To: dev@cloudstack.apache.org 
>> Subject: Dynamic scaling support for KVM
>>
>> Hello Devs,
>>
>> Since long time ago libvirt supports live horizental scaling of VMs. Do you
>> intend for ACS 4.13 to support dynamic scaling of KVM VMs?
>>
>> TIA
>>
>> anurag.awas...@shapeblue.com
>> www.shapeblue.com
>> Amadeus House, Floral Street, London  WC2E 9DPUK
>> @shapeblue
>>
>>
>>


Re: Dynamic scaling support for KVM

2019-08-08 Thread Sven Vogel
+1 from me too. I hope so with refactor or without :)

Von meinem iPhone gesendet


__

Sven Vogel
Teamlead Platform

EWERK RZ GmbH
Brühl 24, D-04109 Leipzig
P +49 341 42649 - 11
F +49 341 42649 - 18
s.vo...@ewerk.com
www.ewerk.com

Geschäftsführer:
Dr. Erik Wende, Hendrik Schubert, Frank Richter
Registergericht: Leipzig HRB 17023

Zertifiziert nach:
ISO/IEC 27001:2013
DIN EN ISO 9001:2015
DIN ISO/IEC 2-1:2011

EWERK-Blog | LinkedIn | Xing | Twitter | Facebook

Auskünfte und Angebote per Mail sind freibleibend und unverbindlich.

Disclaimer Privacy:
Der Inhalt dieser E-Mail (einschließlich etwaiger beigefügter Dateien) ist 
vertraulich und nur für den Empfänger bestimmt. Sollten Sie nicht der 
bestimmungsgemäße Empfänger sein, ist Ihnen jegliche Offenlegung, 
Vervielfältigung, Weitergabe oder Nutzung des Inhalts untersagt. Bitte 
informieren Sie in diesem Fall unverzüglich den Absender und löschen Sie die 
E-Mail (einschließlich etwaiger beigefügter Dateien) von Ihrem System. Vielen 
Dank.

The contents of this e-mail (including any attachments) are confidential and 
may be legally privileged. If you are not the intended recipient of this 
e-mail, any disclosure, copying, distribution or use of its contents is 
strictly prohibited, and you should please notify the sender immediately and 
then delete it (including any attachments) from your system. Thank you.
> Am 08.08.2019 um 18:18 schrieb Anurag Awasthi :
>
> +1 to the feature.
>
> @Fariborz, perhaps open a github issue as a new feature request?
> 
> From: Simon Weller 
> Sent: Thursday, August 8, 2019 6:30 PM
> To: dev@cloudstack.apache.org 
> Subject: Re: Dynamic scaling support for KVM
>
> Hi Fariboz,
>
> We'd definitely like to add that functionality, but it's going to be a fairly 
> big lift, as the libxml configs are currently built as a single block. A 
> large refactor of how we interact with libvirt will be required.
> This is definitely something we have on our list and hopefully we can 
> starting taking a look at it within the next few months.
>
> -Si
> 
> From: Fariborz Navidan 
> Sent: Thursday, August 8, 2019 7:27 AM
> To: dev@cloudstack.apache.org 
> Subject: Dynamic scaling support for KVM
>
> Hello Devs,
>
> Since long time ago libvirt supports live horizental scaling of VMs. Do you
> intend for ACS 4.13 to support dynamic scaling of KVM VMs?
>
> TIA
>
> anurag.awas...@shapeblue.com
> www.shapeblue.com
> Amadeus House, Floral Street, London  WC2E 9DPUK
> @shapeblue
>
>
>


Re: Dynamic scaling support for KVM

2019-08-08 Thread Anurag Awasthi
+1 to the feature.

@Fariborz, perhaps open a github issue as a new feature request?

From: Simon Weller 
Sent: Thursday, August 8, 2019 6:30 PM
To: dev@cloudstack.apache.org 
Subject: Re: Dynamic scaling support for KVM

Hi Fariboz,

We'd definitely like to add that functionality, but it's going to be a fairly 
big lift, as the libxml configs are currently built as a single block. A large 
refactor of how we interact with libvirt will be required.
This is definitely something we have on our list and hopefully we can starting 
taking a look at it within the next few months.

-Si

From: Fariborz Navidan 
Sent: Thursday, August 8, 2019 7:27 AM
To: dev@cloudstack.apache.org 
Subject: Dynamic scaling support for KVM

Hello Devs,

Since long time ago libvirt supports live horizental scaling of VMs. Do you
intend for ACS 4.13 to support dynamic scaling of KVM VMs?

TIA

anurag.awas...@shapeblue.com 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue
  
 



Re: Dynamic scaling support for KVM

2019-08-08 Thread Simon Weller
Hi Fariboz,

We'd definitely like to add that functionality, but it's going to be a fairly 
big lift, as the libxml configs are currently built as a single block. A large 
refactor of how we interact with libvirt will be required.
This is definitely something we have on our list and hopefully we can starting 
taking a look at it within the next few months.

-Si

From: Fariborz Navidan 
Sent: Thursday, August 8, 2019 7:27 AM
To: dev@cloudstack.apache.org 
Subject: Dynamic scaling support for KVM

Hello Devs,

Since long time ago libvirt supports live horizental scaling of VMs. Do you
intend for ACS 4.13 to support dynamic scaling of KVM VMs?

TIA


Dynamic scaling support for KVM

2019-08-08 Thread Fariborz Navidan
Hello Devs,

Since long time ago libvirt supports live horizental scaling of VMs. Do you
intend for ACS 4.13 to support dynamic scaling of KVM VMs?

TIA