Re: [VOTE] 4.11.3.0 RC1

[Riepl, Gregor (SWISS TXT)]

+1

Based on:
- Packages from http://packages.shapeblue.com/testing/41130rc1/ and 
http://packages.shapeblue.com/testing/systemvm/41130rc1/
- Upgrade of our test cloud from 4.11.2 to 4.11.3 worked without problems 
(aside from the mentioned template issue)
- Our internal smoke test stack ran successfully

The only thing I'm a bit unhappy about is the backported ostype API fix: 
https://github.com/apache/cloudstack/pull/3066
Since this is a breaking API change, I don't think it should be included in a 
minor release, even if it fixes an API bug.
It triggers an error in Packer, which we use to create templates.
However, a fix was already commited and will be in the next Packer release, so 
I'm ok'ing it: https://github.com/hashicorp/packer/pull/7694

Re: [VOTE] 4.11.3.0 RC1

[Riepl, Gregor (SWISS TXT)]

So, I think it's ok to leave this issue aside.

I have a suspicion why the templates don't get upgraded, but since we know how 
to fix them manually, it's not release critical.

We'll open a ticket later.



From: Rohit Yadav 
Sent: 13 June 2019 12:49:40
To: dev; us...@cloudstack.apache.org
Subject: Re: [VOTE] 4.11.3.0 RC1

Gregor,


Please follow the following guide, but use the systemvmtemplate URL from the 
mirror shared on this thread and register the template with the name as 
"systemvm--4.11.3" before upgrading to 4.11.3.0-rc1:

http://docs.cloudstack.apache.org/en/4.11.2.0/upgrading/upgrade/upgrade-4.11.html



Regards,

Rohit Yadav

Software Architect, ShapeBlue

https://www.shapeblue.com


From: Andrija Panic 
Sent: Thursday, June 13, 2019 2:45:50 AM
To: dev
Cc: us...@cloudstack.apache.org
Subject: Re: [VOTE] 4.11.3.0 RC1

Gregor,

can you confirm if you followed the steps exactly in regards to template
flags and more importantly the actual name - I believe in the code, during
upgrading, it will search for specific template name (i.e.
systemvm-vmware-4.11.3) and update it's DB values so it becomes a "SYSTEM"
instead of "USER" type that it was initially.

Andrija

On Wed, 12 Jun 2019 at 16:46, Riepl, Gregor (SWISS TXT) <
gregor.ri...@swisstxt.ch> wrote:

> Hi Paul,
>
> > The release notes are still work-in-progress, but the systemvm
> > template upgrade section has been updated. You may refer the
> > following for systemvm template upgrade testing:
> >
> http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/latest/index.html
>
> Thanks!
>
> We're doing our own tests right now, but ran into problems when
> updating the system VMs.
>
> For one, after registering the new VMware systemvm template, it is
> shown as a "USER" template. I'm not sure if this is correct. Is there
> an additional step to ensure it is considered a "SYSTEM" template?
> I believe this is important so the SSVM and Console Proxy get upgraded.
>
> Secondly, the upgrade instructions do not mention updating
> minreq.sysvmtemplate.version
> and
> router.template.
> to the
> version/name of the new template.
>
> Without this step, routers won't be upgraded to the new template.
> IMHO, it should be mentioned in all upgrade instructions.
>
> Should I prepare a PR against the documentation?
>
> Best regards,
> Gregor
>


--

Andrija Panić

rohit.ya...@shapeblue.com
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue

Re: Concurrent Volume Snapshots

[Andrei Mikhailovsky]

Thanks for the update Rohit, Suresh,

Is this feature happening in the 4.13 release?

Andrei

- Original Message -
> From: "Suresh Kumar Anaparti" 
> To: "dev" 
> Sent: Thursday, 13 June, 2019 19:10:11
> Subject: Re: Concurrent Volume Snapshots

> Currently, in CloudStack, only one job per VM can be active (in execution)
> at any given point of time. Here, for concurrent volume snapshots of same
> VM, all these snapshot operations are considered to be the same VM work
> jobs and would be in queue. Once an active volume snapshot job is done, the
> next one is picked up for execution.
> 
> The PR https://github.com/apache/cloudstack/pull/1897 supports multiple
> snapshots of the same VM for XenServer. KVM not tested. I'll rebase the
> code with the latest master.
> 
> Regards,
> Suresh
> 
> 
> On Thu, Jun 13, 2019 at 7:41 PM Rohit Yadav 
> wrote:
> 
>> I checked out outstanding PRs list, looks like this feature is not
>> supported currently:
>>
>> https://github.com/apache/cloudstack/pull/1897
>>
>>
>> Regards,
>>
>> Rohit Yadav
>>
>> Software Architect, ShapeBlue
>>
>> https://www.shapeblue.com
>>
>> 
>> From: Rohit Yadav 
>> Sent: Thursday, June 13, 2019 7:37:09 PM
>> To: dev
>> Subject: Re: Concurrent Volume Snapshots
>>
>> Hi Andrei,
>>
>>
>> Try playing with concurrent.snapshots.threshold.perhost. (empty is treated
>> as 1).
>>
>>
>> Regards,
>>
>> Rohit Yadav
>>
>> Software Architect, ShapeBlue
>>
>> https://www.shapeblue.com
>>
>> 
>> From: Andrei Mikhailovsky 
>> Sent: Thursday, June 13, 2019 6:54:07 PM
>> To: dev
>> Subject: Re: Concurrent Volume Snapshots
>>
>> Hi Rohit,
>>
>> I have updated some of those options to increase the timeout to 2 days
>> rather than a few hours by default.
>>
>> However, these options relate to the timeout of the process.
>>
>> I was wondering if there is an option to allow simultaneous snapshotting
>> of volumes on a single VM? I would like all volumes of the vm to be copied
>> over to the secondary storage at the same time, rather than one after
>> another.
>>
>> Cheers
>>
>>
>> rohit.ya...@shapeblue.com
>> www.shapeblue.com
>> Amadeus House, Floral Street, London  WC2E 9DPUK
>> @shapeblue
>>
>>
>>
>>
>> rohit.ya...@shapeblue.com
>> www.shapeblue.com
>> Amadeus House, Floral Street, London  WC2E 9DPUK
>> @shapeblue
>>
>>
>>
>> - Original Message -
>> > From: "Rohit Yadav" 
>> > To: "dev" 
>> > Sent: Thursday, 13 June, 2019 14:02:21
>> > Subject: Re: Concurrent Volume Snapshots
>>
>> > You can try to experiment with the following global settings:
>> >
>> >
>> > wait
>> >
>> > backup.snapshot.wait
>> > copy.volume.wait
>> > vm.job.lock.timeout
>> >
>> >
>> > Regards,
>> >
>> > Rohit Yadav
>> >
>> > Software Architect, ShapeBlue
>> >
>> > https://www.shapeblue.com
>> >
>> > 
>> > From: Andrei Mikhailovsky 
>> > Sent: Thursday, June 13, 2019 6:27:23 PM
>> > To: dev
>> > Subject: Concurrent Volume Snapshots
>> >
>> > Hello everyone
>> >
>> > I am having running snapshot issues on large volumes. The hypervisor is
>> KVM and
>> > the storage backend is Ceph (rbd). ACS version is 4.11.2. Here is my
>> issue:
>> >
>> > I've got several vms with 3-6 volumes of 2TB each. I have a recurring
>> schedule
>> > setup to take a snapshot of each volume once a month. It takes a long
>> time for
>> > a volume to be snapshotted (in a magnitude of 20 hours). As a result,
>> when the
>> > schedule kicks in, it only manages to snapshot the first volume and the
>> > snapshots of the other volumes fail due to the async job timeout. From
>> what I
>> > have discovered, ACS only does a single volume snapshot at a time. I
>> can't seem
>> > to find the settings to enable concurrent snapshotting. So, it can't
>> snapshot
>> > all of the vm volumes at the same time. This is very much problematic
>> for many
>> > reasons, but the main reason is that upon recovery of multiple volumes,
>> the
>> > data on those will not be consistent.
>> >
>> > Is there a way around it? Perhaps there is an option in the settings
>> that I
>> > can't find that disables this odd behaviour of the volume snapshots?
>> >
>> > Cheers
>> >
>> > Andrei
>> >
>> > rohit.ya...@shapeblue.com
>> > www.shapeblue.com
>> > Amadeus House, Floral Street, London  WC2E 9DPUK
>> > @shapeblue

Re: Hello

[Abhishek Kumar]

Welcome Darrin!


Regards,
Abhishek Kumar


From: Darrin Hüsselmann 
Sent: 13 June 2019 17:44
To: dev@cloudstack.apache.org; us...@cloudstack.apache.org
Subject: Hello

Hi All,


I have joined Shapeblue as a software engineer and look forward to contributing 
to the cloudstack project and working with the community.


Cheers

Darrin


darrin.husselm...@shapeblue.com
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue




abhishek.ku...@shapeblue.com 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue
  
 

Re: Hello

[Riepl, Gregor (SWISS TXT)]

Hi Darrin, welcome!


From: Darrin H?sselmann 
Sent: 13 June 2019 14:14:00
To: dev@cloudstack.apache.org; us...@cloudstack.apache.org
Subject: Hello

Hi All,


I have joined Shapeblue as a software engineer and look forward to contributing 
to the cloudstack project and working with the community.


Cheers

Darrin


darrin.husselm...@shapeblue.com
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue