Re: [DISCUSS] Increase default RAM for virtual routers to 512MB?

[Frank Maximus]

It is possible to select the System offering for VR in the Network Offering
as far as I know.
But no easy way to change the default.

Console Proxy, Secondary Storage and Internal LB do have advanced setting
already.

On Thu, Oct 11, 2018 at 9:00 PM Rafael Weingärtner <
rafaelweingart...@gmail.com> wrote:

> +1 for Wei suggestion
>
> On Thu, Oct 11, 2018 at 3:58 PM Wei ZHOU  wrote:
>
> > It would be better to make router offering configurable in global
> settings.
> >
> >
> >
> > Rohit Yadav  于2018年10月11日周四 下午7:09写道：
> >
> > > All,
> > >
> > >
> > > With 4.11, we migrated to a 64-bit Debian 9 based systemvmtemplate.
> > Debian
> > > 9 (amd64)'s recommended RAM requirement is 512 MB [1], while the
> default
> > > system offering for VRs is set to 256MB RAM and 1 CPU/core. For most
> > > environments, especially those in KVM and XenServer this does not
> present
> > > any issue however on VMware in a particular setup swapping was seen
> (due
> > to
> > > low memory).
> > >
> > >
> > > It is recommended for CloudStack users to benchmark their usage of VRs
> > and
> > > change the default system offering for routers to suitable spec (for
> > > example, for high throughput VRs can have 1-4 multiple cores and maybe
> > > 1-4GBs of RAM).
> > >
> > >
> > > We can incorporate these notes in the official documentation, the open
> > > item to discuss is -- should we change the default (minimum) to 512MB
> RAM
> > > as well for virtual routers?
> > >
> > >
> > > Thoughts?
> > >
> > >
> > > [1] https://www.debian.org/releases/stable/amd64/ch03s04.html.en
> > >
> > >
> > > - Rohit
> > >
> > > 
> > >
> > >
> > >
> > > rohit.ya...@shapeblue.com
> > > www.shapeblue.com
> > > Amadeus House, Floral Street, London  WC2E 9DPUK
> > > @shapeblue
> > >
> > >
> > >
> > >
> >
>
>
> --
> Rafael Weingärtner
>

Re: Integrating Console View

[Frank Maximus]

Hi,

Maybe a little late.
Not sure if signature is necessary.
What should work is storing the cookies returned from logging in,
and making sure those are passed to the request to /client/console.

In unix curl it looks like this:
curl -c cookies --data
command=login\=\=password\=admin\=json
http://localhost:8080/client/api
curl -b cookies http://localhost:8080/client/console?cmd=access=UUID

Regards,
Frank

On Sat, Sep 8, 2018 at 12:09 PM Fariborz Navidan 
wrote:

> Hello Devs,
>
>
>
> I am trying to integrate CloudStack’s Console View into my custom
> application. I have used to get console URL by passing apiKey and Signature
> to “/client/console” page. The URL I get is working well in browser but I
> want to get the actual console URL which is returned by “/client/console”
> inside a  tag. I have tried requesting the URL I have created, with
> PHP’s cURL library so I can parse it and  extract the real console URL. But
> what I get is firstly, 301 redirect which redirects to the same location,
> then a 400 character string  which displayed as emoty string, when I follow
> the location. By running var_dump() I get something like this:
>
>
>
> String(400) “”
>
>
>
> Please help me to achieve my goal.
>
>
>
> Thanks
>

Re: _configDao.isPremium() please help where this information comes from.

[Frank Maximus]

That setting is part of a property file of
cloudstack-plugin-hypervisor-vmware.
Most likely you are using a system build with noredist.
In that case you also need a systemvm build that way.

Kind Regards,
Frank

On Tue, Jul 10, 2018 at 12:16 PM Stephan Seitz 
wrote:

> Hi there,
>
> Upgrading 4.11.0 to 4.11.1 we found an interesting problem in our (well
> played) staging infrastructure.
>
> During SSVN provisioning, a somewhat "premium" configuration is detected
> (well we're using noredist since ... ever?).
> So the SSVM is configured with
>   resource=com.cloud.storage.resource.PremiumSecondaryStorageResource
> instead of
>
> resource=org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource
>
> In fact this particular setup always used (and should further use) simple
> NFS as Secondary Storage.
>
> Sorry, but I can't find the real source
> of com.cloud.configuration.dao.ConfigurationDao#isPremium() and how to set
> this to false.
>
> If anyone could shed some light?
>
>
> Thank You!
>
>
>
>
> Mit freundlichen Grüßen,
>
> Stephan Seitz
>
>
> --
> Heinlein Support GmbH
> Schwedter Str. 8/9b, 10119 Berlin
>
> https://www.heinlein-support.de
>
> Tel: 030 / 405051-44
> Fax: 030 / 405051-19
>
> Amtsgericht Berlin-Charlottenburg - HRB 93818 B
> Geschäftsführer: Peer Heinlein - Sitz: Berlin
>
>

Re: [VOTE] Apache CloudStack 4.11.1.0 LTS [RC1]

[Frank Maximus]

I created CLOUDSTACK-10381
<https://issues.apache.org/jira/browse/CLOUDSTACK-10381>

On Mon, Jun 4, 2018 at 2:10 PM Frank Maximus <
frank.maxi...@nuagenetworks.net> wrote:

> I know that is the expected behavior.
> We stop the VM, do password reset, start the VM, check the config drive
> disk: no password file.
> When starting the VM, Cloudstack doesn't seem to remember the fact the
> password reset was executed.
> A strategy similar to what is done on VRElement in case VR isn't running
> might be needed.
>
>
> On Mon, Jun 4, 2018 at 1:42 PM Rohit Yadav 
> wrote:
>
>> Frank - wrt config drive, the reset password API would require the VM is
>> stopped. After VM is stopped, reset password and start the VM, the new
>> password should be put in the config drive iso:
>>
>>
>> http://cloudstack.apache.org/api/apidocs-4.11/apis/resetPasswordForVirtualMachine.html
>>
>> zx
>>
>>
>> The previous implementation would not require vm to be stopped per ap,
>> and instead do a detach+update iso + attach operation which is fail-prone
>> and may not work for all cases/VMs.
>>
>>
>> - Rohit
>>
>> <https://cloudstack.apache.org>
>>
>>
>>
>> 
>> From: Frank Maximus 
>> Sent: Monday, June 4, 2018 3:47:11 PM
>> To: dev@cloudstack.apache.org
>> Cc: us...@cloudstack.apache.org
>> Subject: Re: [VOTE] Apache CloudStack 4.11.1.0 LTS [RC1]
>>
>> -1.
>>
>> Reset password with ConfigDrive seems to broken.
>> The old password stays in use.
>> Will make a ticket soon.
>> Also the example scripts in setup/bindir need to be changed.
>>
>>
>> On Mon, May 28, 2018 at 10:26 AM Daan Hoogland 
>> wrote:
>>
>> > I checked three verification files, unpacked and build the code, and am
>> > trusting the process otherwise:
>> > 0 (binding)
>> > The reason I am not giving a +1 is because the code presently does not
>> > build on anything but linux, due to the configdrive test not building on
>> > macosx (and I presume windows) If we add that to release notes I am fine
>> > with it.
>> >
>> > On Sat, May 26, 2018 at 5:27 AM, Tutkowski, Mike <
>> > mike.tutkow...@netapp.com>
>> > wrote:
>> >
>> > > +1 (binding)
>> > >
>> > > I created a new cloud using commit
>> > 5f48487dc62fd1decaabc4ab2a10f549d6c82400
>> > > (RC1). I ran the automated regression tests for managed storage. All
>> > tests
>> > > passed.
>> > >
>> > > On 5/24/18, 9:56 AM, "Paul Angus"  wrote:
>> > >
>> > > Hi All,
>> > >
>> > >
>> > >
>> > > I've created a 4.11.1.0 release (RC1), with the following
>> artefacts
>> > up
>> > > for testing and a vote:
>> > >
>> > > [NB we know there are issues for Nuage to sort in this RC, but
>> they
>> > > will be well contained, so let’s test everything else  ]
>> > >
>> > >
>> > >
>> > > Git Branch and Commit SH:
>> > >
>> > > https://gitbox.apache.org/repos/asf?p=cloudstack.git;a=
>> > > shortlog;h=refs/heads/4.11.1.0-RC20180524T1000
>> > >
>> > > Commit: 5f48487dc62fd1decaabc4ab2a10f549d6c82400
>> > >
>> > >
>> > >
>> > > Source release (checksums and signatures are available at the same
>> > >
>> > > location):
>> > >
>> > > https://dist.apache.org/repos/dist/dev/cloudstack/4.11.1.0/
>> > >
>> > >
>> > >
>> > > PGP release keys (signed using 8B309F7251EE0BC8):
>> > >
>> > > https://dist.apache.org/repos/dist/release/cloudstack/KEYS
>> > >
>> > >
>> > >
>> > > The vote will be open till end of next week, 1st June 2018.
>> > >
>> > >
>> > >
>> > > For sanity in tallying the vote, can PMC members please be sure to
>> > > indicate "(binding)" with their vote?
>> > >
>> > >
>> > >
>> > > [ ] +1  approve
>> > >
>> > > [ ] +0  no opinion
>> > >
>> > > [ ] -1  disapprove (and reason why)
>> > >
>> > >
>> > >
>> > > Additional information:
>> > >
>> > >
>> > >
>> > > For users' convenience, I've built packages from
>> > > 5f48487dc62fd1decaabc4ab2a10f549d6c82400 and published RC1 repository
>> > > here:
>> > >
>> > > http://packages.shapeblue.com/testing/4111rc1/
>> > >
>> > >
>> > >
>> > > The release notes are still work-in-progress, but the systemvm
>> > > template upgrade section has been updated. You may refer the following
>> > for
>> > > systemvm template upgrade testing:
>> > >
>> > > http://docs.cloudstack.apache.org/projects/cloudstack-
>> > > release-notes/en/latest/index.html
>> > >
>> > >
>> > >
>> > > 4.11.1 systemvm templates are available from here:
>> > > http://packages.shapeblue.com/systemvmtemplate/4.11.1-rc1/
>> > >
>> > >
>> > > Kind regards,
>> > >
>> > > Paul Angus
>> > >
>> > >
>> > > paul.an...@shapeblue.com
>> > > www.shapeblue.com<http://www.shapeblue.com>
>> > > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
>> > > @shapeblue
>> > >
>> > >
>> > >
>> > >
>> > >
>> > >
>> >
>> >
>> > --
>> > Daan
>> >
>>
>> rohit.ya...@shapeblue.com
>> www.shapeblue.com
>> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
>> @shapeblue
>>
>>
>>
>>

Re: [VOTE] Apache CloudStack 4.11.1.0 LTS [RC1]

[Frank Maximus]

I know that is the expected behavior.
We stop the VM, do password reset, start the VM, check the config drive
disk: no password file.
When starting the VM, Cloudstack doesn't seem to remember the fact the
password reset was executed.
A strategy similar to what is done on VRElement in case VR isn't running
might be needed.


On Mon, Jun 4, 2018 at 1:42 PM Rohit Yadav 
wrote:

> Frank - wrt config drive, the reset password API would require the VM is
> stopped. After VM is stopped, reset password and start the VM, the new
> password should be put in the config drive iso:
>
>
> http://cloudstack.apache.org/api/apidocs-4.11/apis/resetPasswordForVirtualMachine.html
>
> zx
>
>
> The previous implementation would not require vm to be stopped per ap, and
> instead do a detach+update iso + attach operation which is fail-prone and
> may not work for all cases/VMs.
>
>
> - Rohit
>
> <https://cloudstack.apache.org>
>
>
>
> 
> From: Frank Maximus 
> Sent: Monday, June 4, 2018 3:47:11 PM
> To: dev@cloudstack.apache.org
> Cc: us...@cloudstack.apache.org
> Subject: Re: [VOTE] Apache CloudStack 4.11.1.0 LTS [RC1]
>
> -1.
>
> Reset password with ConfigDrive seems to broken.
> The old password stays in use.
> Will make a ticket soon.
> Also the example scripts in setup/bindir need to be changed.
>
>
> On Mon, May 28, 2018 at 10:26 AM Daan Hoogland 
> wrote:
>
> > I checked three verification files, unpacked and build the code, and am
> > trusting the process otherwise:
> > 0 (binding)
> > The reason I am not giving a +1 is because the code presently does not
> > build on anything but linux, due to the configdrive test not building on
> > macosx (and I presume windows) If we add that to release notes I am fine
> > with it.
> >
> > On Sat, May 26, 2018 at 5:27 AM, Tutkowski, Mike <
> > mike.tutkow...@netapp.com>
> > wrote:
> >
> > > +1 (binding)
> > >
> > > I created a new cloud using commit
> > 5f48487dc62fd1decaabc4ab2a10f549d6c82400
> > > (RC1). I ran the automated regression tests for managed storage. All
> > tests
> > > passed.
> > >
> > > On 5/24/18, 9:56 AM, "Paul Angus"  wrote:
> > >
> > > Hi All,
> > >
> > >
> > >
> > > I've created a 4.11.1.0 release (RC1), with the following artefacts
> > up
> > > for testing and a vote:
> > >
> > > [NB we know there are issues for Nuage to sort in this RC, but they
> > > will be well contained, so let’s test everything else  ]
> > >
> > >
> > >
> > > Git Branch and Commit SH:
> > >
> > > https://gitbox.apache.org/repos/asf?p=cloudstack.git;a=
> > > shortlog;h=refs/heads/4.11.1.0-RC20180524T1000
> > >
> > > Commit: 5f48487dc62fd1decaabc4ab2a10f549d6c82400
> > >
> > >
> > >
> > > Source release (checksums and signatures are available at the same
> > >
> > > location):
> > >
> > > https://dist.apache.org/repos/dist/dev/cloudstack/4.11.1.0/
> > >
> > >
> > >
> > > PGP release keys (signed using 8B309F7251EE0BC8):
> > >
> > > https://dist.apache.org/repos/dist/release/cloudstack/KEYS
> > >
> > >
> > >
> > > The vote will be open till end of next week, 1st June 2018.
> > >
> > >
> > >
> > > For sanity in tallying the vote, can PMC members please be sure to
> > > indicate "(binding)" with their vote?
> > >
> > >
> > >
> > > [ ] +1  approve
> > >
> > > [ ] +0  no opinion
> > >
> > > [ ] -1  disapprove (and reason why)
> > >
> > >
> > >
> > > Additional information:
> > >
> > >
> > >
> > > For users' convenience, I've built packages from
> > > 5f48487dc62fd1decaabc4ab2a10f549d6c82400 and published RC1 repository
> > > here:
> > >
> > > http://packages.shapeblue.com/testing/4111rc1/
> > >
> > >
> > >
> > > The release notes are still work-in-progress, but the systemvm
> > > template upgrade section has been updated. You may refer the following
> > for
> > > systemvm template upgrade testing:
> > >
> > > http://docs.cloudstack.apache.org/projects/cloudstack-
> > > release-notes/en/latest/index.html
> > >
> > >
> > >
> > > 4.11.1 systemvm templates are available from here:
> > > http://packages.shapeblue.com/systemvmtemplate/4.11.1-rc1/
> > >
> > >
> > > Kind regards,
> > >
> > > Paul Angus
> > >
> > >
> > > paul.an...@shapeblue.com
> > > www.shapeblue.com<http://www.shapeblue.com>
> > > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> > > @shapeblue
> > >
> > >
> > >
> > >
> > >
> > >
> >
> >
> > --
> > Daan
> >
>
> rohit.ya...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>
>
>
>

Re: [VOTE] Apache CloudStack 4.11.1.0 LTS [RC1]

[Frank Maximus]

-1.

Reset password with ConfigDrive seems to broken.
The old password stays in use.
Will make a ticket soon.
Also the example scripts in setup/bindir need to be changed.


On Mon, May 28, 2018 at 10:26 AM Daan Hoogland 
wrote:

> I checked three verification files, unpacked and build the code, and am
> trusting the process otherwise:
> 0 (binding)
> The reason I am not giving a +1 is because the code presently does not
> build on anything but linux, due to the configdrive test not building on
> macosx (and I presume windows) If we add that to release notes I am fine
> with it.
>
> On Sat, May 26, 2018 at 5:27 AM, Tutkowski, Mike <
> mike.tutkow...@netapp.com>
> wrote:
>
> > +1 (binding)
> >
> > I created a new cloud using commit
> 5f48487dc62fd1decaabc4ab2a10f549d6c82400
> > (RC1). I ran the automated regression tests for managed storage. All
> tests
> > passed.
> >
> > On 5/24/18, 9:56 AM, "Paul Angus"  wrote:
> >
> > Hi All,
> >
> >
> >
> > I've created a 4.11.1.0 release (RC1), with the following artefacts
> up
> > for testing and a vote:
> >
> > [NB we know there are issues for Nuage to sort in this RC, but they
> > will be well contained, so let’s test everything else  ]
> >
> >
> >
> > Git Branch and Commit SH:
> >
> > https://gitbox.apache.org/repos/asf?p=cloudstack.git;a=
> > shortlog;h=refs/heads/4.11.1.0-RC20180524T1000
> >
> > Commit: 5f48487dc62fd1decaabc4ab2a10f549d6c82400
> >
> >
> >
> > Source release (checksums and signatures are available at the same
> >
> > location):
> >
> > https://dist.apache.org/repos/dist/dev/cloudstack/4.11.1.0/
> >
> >
> >
> > PGP release keys (signed using 8B309F7251EE0BC8):
> >
> > https://dist.apache.org/repos/dist/release/cloudstack/KEYS
> >
> >
> >
> > The vote will be open till end of next week, 1st June 2018.
> >
> >
> >
> > For sanity in tallying the vote, can PMC members please be sure to
> > indicate "(binding)" with their vote?
> >
> >
> >
> > [ ] +1  approve
> >
> > [ ] +0  no opinion
> >
> > [ ] -1  disapprove (and reason why)
> >
> >
> >
> > Additional information:
> >
> >
> >
> > For users' convenience, I've built packages from
> > 5f48487dc62fd1decaabc4ab2a10f549d6c82400 and published RC1 repository
> > here:
> >
> > http://packages.shapeblue.com/testing/4111rc1/
> >
> >
> >
> > The release notes are still work-in-progress, but the systemvm
> > template upgrade section has been updated. You may refer the following
> for
> > systemvm template upgrade testing:
> >
> > http://docs.cloudstack.apache.org/projects/cloudstack-
> > release-notes/en/latest/index.html
> >
> >
> >
> > 4.11.1 systemvm templates are available from here:
> > http://packages.shapeblue.com/systemvmtemplate/4.11.1-rc1/
> >
> >
> > Kind regards,
> >
> > Paul Angus
> >
> >
> > paul.an...@shapeblue.com
> > www.shapeblue.com
> > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> > @shapeblue
> >
> >
> >
> >
> >
> >
>
>
> --
> Daan
>

Re: [VOTE] Apache Cloudstack 4.11.0.0 (LTS)

[Frank Maximus]

I found and fixed an issue in cloudstack-agent logrotate.

https://issues.apache.org/jira/browse/CLOUDSTACK-10255
https://github.com/apache/cloudstack/pull/2429

IMHO it's feasible to include it in RC2.
As only the maven build is impacted by the change,
I see little risk.

Regards,
Frank


On Wed, Jan 24, 2018 at 1:31 PM Rohit Yadav 
wrote:

> All,
>
>
> We don't have any outstanding blocker PRs now.
>
>
> I could n't reproduce any regression wrt only VM-HA in RC1. By killing a
> HV host (and keep it that way, i.e. not rebooting it), HA enabled VMs did
> migrate to other hosts in a test I did.
>
>
> The only potential (blocker) issue seems to be a ldap related regression
> reported on users@ that Daan is looking into, which may or may not be a
> blocker but a configuration issue.
>
>
> Given, we're approaching the end of the week, it's likely we cut RC2 on
> Monday. Please continue testing RC1 in the meanwhile.
>
>
> Regards,
>
> Rohit Yadav
>
>
> 
> From: Nux! 
> Sent: Wednesday, January 24, 2018 9:29:21 AM
> To: users
> Cc: dev
> Subject: Re: [VOTE] Apache Cloudstack 4.11.0.0 (LTS)
>
> Paul,
>
> Ok, let me play some more with those tunings params, see if I can find a
> satisfactory combination and I'll withhold a -1 on this on the basis that
> I've just misunderstood the whole thing. :)
>
> Thanks
>
> --
> Sent from the Delta quadrant using Borg technology!
>
> Nux!
> www.nux.ro
>
>
> rohit.ya...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>
>
>
> - Original Message -
> > From: "Paul Angus" 
> > To: "users" 
> > Cc: "dev" 
> > Sent: Tuesday, 23 January, 2018 19:55:01
> > Subject: RE: [VOTE] Apache Cloudstack 4.11.0.0 (LTS)
>
> > Hey Nux,
> >
> > There is quite a bit of tuning you can do, to speed or slow CloudStack's
> > decision making, but we need to be sure that when we lose contact with a
> host
> > agent, that the VMs themselves really are dead.  By default host-ha is
> set to
> > be super sure.
> >
> > There are various timeouts which can be configured to decide how long to
> wait
> > for a host to restart before deciding that it is not going to start as
> well as
> > how many times we should check for disk activity from the resident VMs
> of a
> > suspect host.
> >
> > The parameters are detailed here.
> > https://cwiki.apache.org/confluence/display/CLOUDSTACK/Host+HA
> >
> > Honestly, the aim of Host HA was to fix the particular issue that you are
> > describing as we can't remember a time when it did work reliably.
> >
> >
> >
> > paul.an...@shapeblue.com
> > www.shapeblue.com
> > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> > @shapeblue
> >
> >
> >
> >
> > -Original Message-
> > From: Nux! [mailto:n...@li.nux.ro]
> > Sent: 23 January 2018 19:08
> > To: users 
> > Cc: dev 
> > Subject: Re: [VOTE] Apache Cloudstack 4.11.0.0 (LTS)
> >
> > Hi Paul,
> >
> > To be honest I do not remember when I last saw this, as I have not been
> testing
> > ACS in 2017.
> > You'd kill a HV, the VMs would pop up on another after a few minutes.
> >
> > Even with Host HA, the VMs remain down until the hypervisor is back up,
> > restarted by OOBM - however if that HV has suffered a HW fault and needs
> to be
> > removed, then those VM will be down for a long time ...
> >
> > Unless I got things quite wrong, (VM) HA - one of the big selling points
> of ACS
> > - is essentially broken?
> >
> > --
> > Sent from the Delta quadrant using Borg technology!
> >
> > Nux!
> > www.nux.ro
> >
> > - Original Message -
> >> From: "Paul Angus" 
> >> To: "users" , "dev"
> >> 
> >> Sent: Tuesday, 23 January, 2018 16:02:54
> >> Subject: RE: [VOTE] Apache Cloudstack 4.11.0.0 (LTS)
> >
> >> Hi Nux,
> >>
> >> When have you seen the VMs on KVM behaving in the manner which you are
> >> expecting?  I recall it didn’t work that way in the mid 4.5 versions
> >> (we found out the hard way in front of a customer) and it doesn't
> >> behave the way you are expecting 4.9 - I've just tested it.
> >>
> >> You need host-ha enabled to get reliable HA in the event of a host
> >> crash, that is why we developed the host ha feature.
> >>
> >> Kind regards,
> >>
> >> Paul Angus
> >>
> >> paul.an...@shapeblue.com
> >> www.shapeblue.com
> >> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue
> >>
> >>
> >>
> >>
> >> -Original Message-
> >> From: Nux! [mailto:n...@li.nux.ro]
> >> Sent: 23 January 2018 15:06
> >> To: dev 
> >> Cc: users 
> >> Subject: Re: [VOTE] Apache Cloudstack 4.11.0.0 (LTS)
> >>
> >> Rohit,
> >>
> >> I'll also have to insist with the 

Re: [UPDATE] Debian 9 "stretch" systemvmtemplate for master

[Frank Maximus]

I would like to test it including the changes for config drive,
but I wasn't able to build it behind a proxy,
so I the fixed I did to build systemvm behind proxy are not working anymore.

If you could include genisoimage in the install_systemvm_packages.sh
,

then we could use the official ones.

Regards,
Frank

On Thu, Dec 21, 2017 at 3:35 PM Rohit Yadav 
wrote:

> All,
>
>
> In the last smoke test run yesterday, all of them passed on VMware 5.5u3,
> VMware 6.5+dvswitch, CentOS7 and XenServer 6.5sp1. The PR has now two code
> reviews (approved/lgtms) to qualify for merging this, however, I'll hold
> merging the PR until another smoketest round since master has changed and
> at that same time request for more reviews. If anyone has any concerns or
> objections to merging this, please do share.
>
>
> I'll also kick component tests tomorrow or over the weekends for VMware,
> KVM, and XenServer and make adjustments to tests etc if necessary.
>
>
> Regards,
>
> Rohit Yadav
>
> Software Architect, ShapeBlue
>
> http://rohityadav.cloud | @rhtyd
>
>
>   __?.o/  Apache CloudStack
>  ()# The best IaaS cloud platform
> (___(_)   https://cloudstack.apache.org
>
>
> 
> From: Rohit Yadav 
> Sent: Tuesday, December 19, 2017 12:38:49 AM
> To: dev@cloudstack.apache.org; Wido den Hollander
> Cc: us...@cloudstack.apache.org
> Subject: Re: [UPDATE] Debian 9 "stretch" systemvmtemplate for master
>
> Hi Wido,
>
> Thanks. I've verified, virtio-scsi seems to work for me. Qemu guest agent
> also works, I was able to write poc code to get rid of patchviasocket.py as
> well. Can you help review and test the PR?
>
> Regards.
> 
> From: Wido den Hollander 
> Sent: Saturday, December 9, 2017 12:32:24 AM
> To: dev@cloudstack.apache.org; Rohit Yadav
> Cc: us...@cloudstack.apache.org
> Subject: Re: [UPDATE] Debian 9 "stretch" systemvmtemplate for master
>
> Awesome work!
>
> More replies below
>
> On 12/08/2017 03:58 PM, Rohit Yadav wrote:
> > All,
> >
> >
> > Our effort to move to Debian9 systemvmtemplate seems to be soon coming
> to conclusion, the following high-level goals have been achieved so far:
> >
> >
> > - Several infra improvements such as faster patching (no reboots on
> patching), smaller setup/patch scripts and even smaller cloud-early-config,
> old file cleanups and directory/filesystem refactorings
> >
> > - Tested and boots/runs on KVM, VMware, XenServer and HyperV (thanks to
> Paul for hyperv)
> >
> > - Boots, patches, runs systemvm/VR in about 10s (tested with
> KVM/XenServer and NFS+SSDs) with faster console-proxy (cloud) service launch
> >
> > - Disk size reduced to 2GB from the previous 3+GB with still bigger
> /var/log partition
> >
> > - Migration to systemd based cloud-early-config, cloud services etc
> (thanks Wido!)
> >
> > - Strongswan provided vpn/ipsec improvements (ports based on work from
> Will/Syed)
> >
> > - Several fixes to redundant virtual routers and scripts for VPC (ports
> from Remi json/gzip PR and additional fixes/improvements to execute
> update_config faster)
> >
> > - Packages installation improvements (thanks to Rene for review)
> >
> > - Several integration test fixes -- all smoke tests passing on KVM and
> most on XenServer, work on fixing VMware test failures is on-going
> >
> > - Several UI/UX improvements and systemvm python codebase linting/unit
> tests added to Travis
> >
> >
> > Here's the pull request:
> >
> > https://github.com/apache/cloudstack/pull/2211
> >
> >
> > I've temporarily hosted the templates here:
> >
> > http://hydra.yadav.xyz/debian9/
> >
> >
> > Outstanding tasks/issues:
> >
> > - Should we skip rVR related tests for VMware noting a reference to a
> jira ticket to renable them once the feature is support for VMware?
> >
> > - Fix intermittent failures for XenServer and test failures on VMware
> >
> > - Misc issues and items (full checklist available on the PR)
> >
> > - Review and additional test effort from community
> >
> >
> > After your due review, if we're able to show that the test results are
> on par with the previous 4.9.2.0/4.9.3.0 smoke test results (i.e. most
> are passing) on XenServer, KVM, and VMware I would proceed with merging the
> PR by end of this month. Thoughts, comments?
> >
>
> We might want to look/verify that this works:
>
> - Running with VirtIO-SCSI under KVM (allows disk trimming)
> - Make sure the Qemu Guest Agent works
>
> If those two things work we can keep the footprint of the SSVM rather
> small.
>
> Wido
>
> >
> > Regards.
> >
> > rohit.ya...@shapeblue.com
> > www.shapeblue.com
> > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> > @shapeblue
> >
> >
> >
> >
>
> rohit.ya...@shapeblue.com
> www.shapeblue.com
> 53 Chandos 

Re: Remote debugging not working anymore

[Frank Maximus]

I just found this website:
https://docs.oracle.com/javase/7/docs/webnotes/tsg/TSG-VM/html/envvars.html

Apparently you can set the JAVA_TOOL_OPTIONS environment variable to pass
options to JVM instantiation, in case it's not under your control.

So debug can be enabled by adding the following line to
/etc/default/cloudstack-management:
JAVA_TOOL_OPTIONS="-agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=5000"

Kind Regards, and happy debugging,
Frank

On Mon, Nov 13, 2017 at 3:58 PM Marc-Aurèle Brothier - Exoscale <
ma...@exoscale.ch> wrote:

> @rhtyd - the java-opts file content (+ read in the startup script)
> should be put back to allow startup customization.
>
>
>
> On Mon, 2017-11-13 at 15:18 +0100, Sigert GOEMINNE wrote:
> > Hi all,
> >
> > Starting from the changes in PR2226
> > , what do i need to
> > specify
> > to enable remote debugging on a system? Before I added
> > -agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=5005 in
> > /etc/default/cloudstack-management and restarted the cloudstack mgmt
> > server
> > but apparently this doesn't work anymore. If i run netstat -tlpn, It
> > is not
> > showing port 5005 in my case. Do I need to change something in our
> > test
> > infrastructure?
> >
> > Thanks.
> > Kind regards,
> > Sigert
>

Re: 4.9 / 4.10 KVM + openvswitch + vpc + static nat / secondary ip on eth2?

[Frank Maximus]

That seems to be a bug in the lookup of the device number, in case of
openvswitch.
The config clearly sets device to eth2, while it should be eth1.

More specifically:
in LibvirtComputingResource.prepareNetworkElementCommand()
The broadcastUriToNicNum map is filled depending on the VR nics.
In openvswitch the guest bridge is used as is, so it overwrites the mapping
of public.
This was not an issue until 4.6 as then VR was using the macaddress to do
lookup,
while now it is using the device number.

Kind Regards,
Frank


On Tue, Oct 31, 2017 at 8:35 PM Frank Maximus <
frank.maxi...@nuagenetworks.net> wrote:

> I think that the bug you mentioned might not be related.
> Could you please send the content of the file /etc/cloudstack/ips.json on
> the VR.
>
> That might provide useful information.
>
> Kind regards,
> Frank
>
> On Tue, 31 Oct 2017 15:23 Vogel, Sven, <sven.vo...@kupper-computer.com>
> wrote:
>
>> Hi Devs,
>>
>> i have the following problem.
>>
>> When I look this jira ticket I see no solution.
>> https://issues.apache.org/jira/browse/CLOUDSTACK-6801  but I think the
>> problem is not solved correctly.
>>
>> 1. KVM
>> 2. Bridges
>> bond with two interfaces and trunk (0,129,180,100-1500) to cloudbr0
>> Cloudbr0 (0 - guest network)
>> Fakebridge pub129 (public network)
>> Fakebridge sto180 (secondary storage network)
>> Fakebridge  mgmt0 (management)
>>
>> If I have a vpc all things work until I add a secondary ip and add a
>> static nat.
>>
>> The following will happen, first address will be on the the correct
>> interface 146.0.122.134/26 but static nat will be on the false network.
>> Its on the eth2…
>>
>> root@r-29-VM:~# ip a
>> 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN
>> link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
>> inet 127.0.0.1/8 scope host lo
>> 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast
>> state UP qlen 1000
>> link/ether 0e:00:a9:fe:03:81 brd ff:ff:ff:ff:ff:ff
>> inet 169.254.3.129/16 brd 169.254.255.255 scope global eth0
>> 3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast
>> state UP qlen 1000
>> link/ether 1e:00:2c:00:00:68 brd ff:ff:ff:ff:ff:ff
>> inet 146.0.122.134/26 brd 146.0.122.191 scope global eth1
>> 4: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast
>> state UP qlen 1000
>> link/ether 02:00:57:07:00:0c brd ff:ff:ff:ff:ff:ff
>> inet 192.168.1.254/24 brd 192.168.1.255 scope global eth2
>> inet 146.0.122.135/26 brd 146.0.122.191 scope global eth2
>>
>> Normally I think the secondary ip should be on signed to eth1 not eth2!
>> It sets my ip on the guest network vlan range on my cloudbr0 but it should
>> be pub129. vnet6 has 1353 guest tag and not the public tag.
>>
>> [root@kvm01 ~]# ovs-vsctl list-br
>> cloud0
>> cloudbr0
>> mgmt0
>> pub129
>> sto180
>>
>> [root@kvm01 ~]# virsh domiflist r-29-VM
>> Interface  Type   Source Model   MAC
>> ---
>> vnet4  bridge cloud0 virtio  0e:00:a9:fe:03:81
>> vnet5  bridge pub129 virtio  1e:00:2c:00:00:68
>> vnet6  bridge cloudbr0   virtio  02:00:57:07:00:0c
>>
>> Bridge "cloud0"
>> Port "vnet4"
>> Interface "vnet4"
>>
>> Port "vnet5"
>> tag: 129
>> Interface "vnet5"
>> Port "vnet6"
>> tag: 1353
>> Interface "vnet6"
>>
>> Whats wrong or what can I do to fix this? I hope anybody has an idea.
>>
>>
>> greetings
>> Sven Vogel
>> Head of Cloud Solutions / Consultants
>> Kupper Computer GmbH
>> Prager Str. 15
>> 04103 Leipzig
>>
>>
>>

Re: 4.9 / 4.10 KVM + openvswitch + vpc + static nat / secondary ip on eth2?

[Frank Maximus]

I think that the bug you mentioned might not be related.
Could you please send the content of the file /etc/cloudstack/ips.json on
the VR.

That might provide useful information.

Kind regards,
Frank

On Tue, 31 Oct 2017 15:23 Vogel, Sven, 
wrote:

> Hi Devs,
>
> i have the following problem.
>
> When I look this jira ticket I see no solution.
> https://issues.apache.org/jira/browse/CLOUDSTACK-6801  but I think the
> problem is not solved correctly.
>
> 1. KVM
> 2. Bridges
> bond with two interfaces and trunk (0,129,180,100-1500) to cloudbr0
> Cloudbr0 (0 - guest network)
> Fakebridge pub129 (public network)
> Fakebridge sto180 (secondary storage network)
> Fakebridge  mgmt0 (management)
>
> If I have a vpc all things work until I add a secondary ip and add a
> static nat.
>
> The following will happen, first address will be on the the correct
> interface 146.0.122.134/26 but static nat will be on the false network.
> Its on the eth2…
>
> root@r-29-VM:~# ip a
> 1: lo:  mtu 16436 qdisc noqueue state UNKNOWN
> link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
> inet 127.0.0.1/8 scope host lo
> 2: eth0:  mtu 1500 qdisc pfifo_fast
> state UP qlen 1000
> link/ether 0e:00:a9:fe:03:81 brd ff:ff:ff:ff:ff:ff
> inet 169.254.3.129/16 brd 169.254.255.255 scope global eth0
> 3: eth1:  mtu 1500 qdisc pfifo_fast
> state UP qlen 1000
> link/ether 1e:00:2c:00:00:68 brd ff:ff:ff:ff:ff:ff
> inet 146.0.122.134/26 brd 146.0.122.191 scope global eth1
> 4: eth2:  mtu 1500 qdisc pfifo_fast
> state UP qlen 1000
> link/ether 02:00:57:07:00:0c brd ff:ff:ff:ff:ff:ff
> inet 192.168.1.254/24 brd 192.168.1.255 scope global eth2
> inet 146.0.122.135/26 brd 146.0.122.191 scope global eth2
>
> Normally I think the secondary ip should be on signed to eth1 not eth2! It
> sets my ip on the guest network vlan range on my cloudbr0 but it should be
> pub129. vnet6 has 1353 guest tag and not the public tag.
>
> [root@kvm01 ~]# ovs-vsctl list-br
> cloud0
> cloudbr0
> mgmt0
> pub129
> sto180
>
> [root@kvm01 ~]# virsh domiflist r-29-VM
> Interface  Type   Source Model   MAC
> ---
> vnet4  bridge cloud0 virtio  0e:00:a9:fe:03:81
> vnet5  bridge pub129 virtio  1e:00:2c:00:00:68
> vnet6  bridge cloudbr0   virtio  02:00:57:07:00:0c
>
> Bridge "cloud0"
> Port "vnet4"
> Interface "vnet4"
>
> Port "vnet5"
> tag: 129
> Interface "vnet5"
> Port "vnet6"
> tag: 1353
> Interface "vnet6"
>
> Whats wrong or what can I do to fix this? I hope anybody has an idea.
>
>
> greetings
> Sven Vogel
> Head of Cloud Solutions / Consultants
> Kupper Computer GmbH
> Prager Str. 15
> 04103 Leipzig
>
>
>

[COLLAB] Config Drive - Storage

[Frank Maximus]

Hi,

As discussed in the Cloudstack Quarterly Call by Kris Sterckx,
we would like to collaborate while implementing the copying of Config Drive
iso to Primary Storage.

The code, including the initial implementation, is available on my personal
fork:
https://github.com/fmaximus/cloudstack/commits/feature/config_drive

I also set up a channel on Slack for real-time discussion.
Anyone else who wants to join in, welcome.

Kind Regards,


*Frank Maximus *

Senior Software Development Engineer



*nuage*networks.net
​Copernicuslaan 50

2018 Antwerp

Belgium

[DISCUSS] Design: Physical Networking Migration

[Frank Maximus]

Hi all,

Please be invited to review our design document,
which enables users to migrate networks to another physical network.

https://cwiki.apache.org/confluence/display/CLOUDSTACK/Physical+Networking+Migration

Regards,
Frank Maximus

Re: Handling of DB migrations on forks

[Frank Maximus]

I'm also in favor of Liquibase.
Hibernate might be smart enough to add new columns,
but to be able to for example change the type of a column,
more complex data migration might be necessary.
Liquibase preconditions, combined with good identifiers
make up that upgrades will be more granular.


*Frank Maximus *
Senior Software Development Engineer
*nuage*networks.net <http://nuagenetworks.net>
p: (+32) 3 240 73 81 <+32%203%20240%2073%2081>


On Tue, Feb 21, 2017 at 10:31 AM Jeff Hair <j...@greenqloud.com> wrote:

Something like Liquibase would be nice. Hibernate might be even better.
Even idempotent migrations would be a step in the right direction. Perhaps
reject any migration changes that aren't INSERT IGNORE, DROP IF EXISTS, etc?

I'm not sure why the DAO was originally hand-rolled. Perhaps the original
developers didn't think any ORM on the market met their needs. I would love
to leave DB migrations almost entirely behind. I believe Hibernate is smart
enough to construct dynamic migrations when fields are added and removed
from tables, right?

*Jeff Hair*
Technical Lead and Software Developer

Tel: (+354) 415 0200 <+354%20415%200200>
j...@greenqloud.com
www.greenqloud.com

On Tue, Feb 21, 2017 at 9:27 AM, Daan Hoogland <daan.hoogl...@shapeblue.com>
wrote:

> Marc-Aurele, you are totally right and people agree with you but no one
> seems to give this priority
>
> daan.hoogl...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, Utrecht Utrecht 3531 VENetherlands
> @shapeblue
>
>
>
>
> -Original Message-
> From: Marc-Aurèle Brothier [mailto:ma...@exoscale.ch]
> Sent: 21 February 2017 10:04
> To: dev@cloudstack.apache.org
> Subject: Re: Handling of DB migrations on forks
>
> IMO the database changes should be idempotent as much as possible with
> "CREATE OR REPLACE VIEW..." "DROP IF EXISTS". For other things like
> altering a table, it's more complicated to achieve that in pure SQL.
> A good call would be to integrate http://www.liquibase.org/ to manage the
> schema and changes in a more descriptive way which allows branches/merges.
>
> On Tue, Feb 21, 2017 at 9:46 AM, Daan Hoogland <daan.hoogl...@gmail.com>
> wrote:
>
> > Good strategy and I would make that not a warning but a fatal, as the
> > resulting ACS version will probably not work.
> >
> > On Tue, Feb 14, 2017 at 12:16 PM, Wei ZHOU <ustcweiz...@gmail.com>
> wrote:
> > > Then you have to create your own branch forked from 4.10.0
> > >
> > > In our branch, I moved some table changes (eg ALTER TABLE, CREATE
> > > TABLE) from schema-.sql to
> > > engine/schema/src/com/cloud/upgrade/dao/UpgradeXXXtoYYY.java.
> > > If SQLException is throwed, then show a warning message instead
> > > upgrade interruption..
> > > By this way, the database will not be broken in the upgrade or fresh
> > > installation.
> > >
> > > -Wei
> > >
> > >
> > > 2017-02-14 11:52 GMT+01:00 Jeff Hair <j...@greenqloud.com>:
> > >
> > >> Hi all,
> > >>
> > >> Many people in the CS community maintain forks of CloudStack, and
> > >> might have implemented features or bug fixes long before they get
> > >> into
> > mainline.
> > >> I'm curious as to how people handle database migrations with their
> > forks.
> > >> To make a DB migration, the CS version must be updated. If a
> > >> developer
> > adds
> > >> a migration to their fork on say, version 4.8.5. Later, they decide
> > >> to upgrade to 4.10.0 which has their migration in the schema
> > >> upgrade to 4.10.0.
> > >>
> > >> How do people handle this? As far as I know, CS will crash on the
> > >> DB upgrade due to SQL errors. Do people just sanitize migrations
> > >> when they pull from downstream or somehting?
> > >>
> > >> Jeff
> > >>
> >
> >
> >
> > --
> > Daan
> >
>

Re: PRs for 4.10

[Frank Maximus]

I have a couple of bugfixes on previous version outstanding,
which I would like to have merged to 4.10,
both still requiring review:
on 4.8: PR#1912 : which
fixes password service running on internal lb vms, making it impossible to
do loadbalancing on port 8080
on 4.9: PR#1925 : Minor
plugin fix

Kind Regards,
Frank

On Tue, Feb 14, 2017 at 10:56 PM Syed Ahmed  wrote:

I'd like to include https://github.com/apache/cloudstack/pull/1928 to 4.10
as well. This is a simple fix that adds hypervisor capabilities for
XenServer 7

Thanks,
-Syed

On Tue, Feb 14, 2017 at 12:06 AM, Will Stevens 
wrote:

> Not sure, I will see if I can find some time tomorrow to look at this.
> Thanks...
>
> *Will STEVENS*
> Lead Developer
>
> 
>
> On Mon, Feb 13, 2017 at 11:58 PM, Rajani Karuturi 
> wrote:
>
> > Thanks Will. I will take a look at this today and merge.
> >
> > Is it possible to add a systemvmtemplate job on
> > builds.apachecloudstack.net (https://builds.cloudstack.org/)
> > similar to
> > http://jenkins.buildacloud.org/job/build-systemvm64-master/ ?
> >
> > Thanks,
> >
> > ~ Rajani
> >
> > http://cloudplatform.accelerite.com/
> >
> > On February 13, 2017 at 10:46 PM, Will Stevens
> > (wstev...@cloudops.com) wrote:
> >
> > At this point, I think 1741 is ready to merge. I think we need
> > one more
> > LGTM though...
> >
> > *Will STEVENS*
> > Lead Developer
> >
> > 
> >
> > On Wed, Feb 8, 2017 at 11:32 AM, Will Stevens
> >  wrote:
> >
> > @Daan: In order for the tests to pass with 1741, the tests have
> > to be run
> > with the SystemVM from the PR being used.
> >
> > *Will STEVENS*
> > Lead Developer
> >
> > 
> >
> > On Wed, Feb 8, 2017 at 2:46 AM, Daan Hoogland
> > 
> > wrote:
> >
> > About 1741, I started the packaging, Will but saw Boris making a
> > remark about the system VMs. I'll look into that and start the
> > tests.
> >
> > On Tue, Feb 7, 2017 at 8:19 PM, Will Stevens
> > 
> > wrote:
> >
> > I would like to get 1741(strongswan) in, but I need to get
> > Trillian to
> >
> > run
> >
> > against it with a system vm built from my pr. I have done a CI in
> > bubble
> > and it came back clean, but would like confirmation through
> > Trillian as
> > well.
> >
> > On Feb 7, 2017 2:17 PM, "Milamber"  wrote:
> >
> > And this PR for 4.9 but need to be foward to 4.10 too.
> >
> > https://github.com/apache/cloudstack/pull/1929
> >
> > 2 LGTM
> > CI green
> >
> > On 07/02/2017 13:07, Rajani Karuturi wrote:
> >
> > Hi all,
> > If you know of any PRs which meet the below criteria, please
> > mail
> >
> > them to
> >
> > me.
> > 1. No open questions.
> > 2. Has two LGTMs
> > 3. Has CI test results.
> >
> > ~Rajani
> > http://cloudplatform.accelerite.com
> >
> > --
> > Daan
> >
>

Re: RM for 4.10/master

[Frank Maximus]

I want to also highlight our plug-in update, which resolves a
ClassNotFoundException, occurring after the update to the latest version of
Amazon aws client.

https://github.com/apache/cloudstack/pull/1904

Once we have our own test infrastructure ready for 1.8, we will post our
test results.

Regards,
Frank

On Wed, 25 Jan 2017 04:17 Tutkowski, Mike, 
wrote:

Hi Rajani,

I’m not sure when you’ll be building your list of PRs to put into 4.10, but
could you consider this one (it addresses an issue that went into 4.10 with
PR 1600)?

https://github.com/apache/cloudstack/pull/1749

Thanks!
Mike

On 1/24/17, 4:49 PM, "Rajani Karuturi"  wrote:

We are facing some issues with our intenral CI post java8
changes. It might take a couple of days to resolve.

I will start merging the PRs once that is done. Meanwhile, I will
start reviewing the PRs.

I am tentatively looking at creating RC at the end of Feb.

Thanks,

~ Rajani

http://cloudplatform.accelerite.com/

On January 19, 2017 at 8:34 PM, Simon Weller (swel...@ena.com)
wrote:

Great, thanks Rajani!


From: Rajani Karuturi 
Sent: Thursday, January 19, 2017 1:15 AM
To: dev@cloudstack.apache.org
Subject: Re: RM for 4.10/master

Yes. thats true. Offlate I was busy with $dayjob activities and
wasnt able to give it enough time.

Starting next week, I will start working on it.

@Rohit, Is it possible to give me access to run CI?

~ Rajani

http://cloudplatform.accelerite.com/

On January 18, 2017 at 11:13 PM, Simon Weller (swel...@ena.com)
wrote:

I think Rajani had originally volunteered to be RM for 4.10 a
couple of months back.


From: Sergey Levitskiy 
Sent: Wednesday, January 18, 2017 11:34 AM
To: dev@cloudstack.apache.org
Subject: Re: RM for 4.10/master

There are many PR in the merge ready state or require
BlueOrangutan testing. Are there volunteers for 4.10 RM role?

On 1/16/17, 4:46 AM, "Rohit Yadav" 
wrote:

All,

I will be on holidays after 18th January and have other work
commitments, I won't be able to contribute much time on RM work.

Please feel free to take up RM responsibilities for 4.10
release, as per our schedule we wanted to freeze it by end of
this month. I can work with the new RM and help them use
@blueorangutan and Trillian for test related work.

Regards.

rohit.ya...@shapeblue.com
www.shapeblue.com
ShapeBlue - The CloudStack Company
www.shapeblue.com
( http://www.shapeblue.com )
Introduction Upgrading CloudStack can sometimes be a little
daunting - but as the 5P's proverb goes - Proper Planning
Prevents Poor Performance.

53 Chandos Place, Covent Garden, London WC2N 4HSUK
@shapeblue

Re: [VOTE] Release Apache CloudStack CloudMonkey 5.3.3

[Frank Maximus]

+1
At Nuage Networks, as we depend on one of the changes,
we've been deploying the code of the master branch for some time
on our test infrastucture.

On Thu, Nov 3, 2016 at 5:33 AM Rohit Yadav 
wrote:

> Hi All,
>
> I've created a 5.3.3 release-candidate of CloudMonkey, with the following
> artifacts up for a vote:
>
> Git Branch and Commit SH:
>
> https://git-wip-us.apache.org/repos/asf?p=cloudstack-cloudmonkey.git;a=shortlog;h=refs/heads/master
> Commit: 319c2dc097fcf7607d352d9fb26f13e8051074ff
>
> List of changes:
>
> https://git-wip-us.apache.org/repos/asf?p=cloudstack-cloudmonkey.git;a=blob_plain;f=CHANGES;hb=master
>
> Source release (checksums and signatures are available at the same
> location):
> https://dist.apache.org/repos/dist/dev/cloudstack/cloudmonkey-5.3.3/
>
> PGP release keys (signed using 0EE3D884):
> https://dist.apache.org/repos/dist/release/cloudstack/KEYS
>
> Vote will be open for 72 hours.
>
> For sanity in tallying the vote, can PMC members please be sure to
> indicate "(binding)" with their vote?
>
> [ ] +1  approve
> [ ] +0  no opinion
> [ ] -1  disapprove (and reason why)
>
>
> Regards.
>
> rohit.ya...@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
> @shapeblue
>
>
>
>

Re: Issue with SSVM on KVM on master

[Frank Maximus]

Make sure that the VMware plug-ins are not in the war on the management
server, when using kvm. If they are, other options get send to the ssvm,
and then it will fail. All has to do with a property premium=true being set
when spring loads the VMware plug-in.

Regards, Frank

On Tue, 11 Oct 2016 16:14 Tutkowski, Mike, 
wrote:

As a little correction to what I said, I meant to ask if there is a way in
4.10 to run system VMs without using noredist for the build as I only have
KVM hosts in this particular environment.

This does seem to work fine in 4.5, so it appears something has changed
since that release in this regard.

> On Oct 11, 2016, at 12:15 AM, Tutkowski, Mike 
wrote:
>
> Hi Rajani,
>
> I actually ended up getting diverted to other work and am just coming
back to this now. ☺
>
> Do you know if there’s a way in 4.10 to run the KVM agent without needing
the noredist option? In this environment, I only have KVM hosts.
>
> I recently tried this in 4.5 and it worked fine without having to do
anything special. It seems something has changed since 4.5 here.
>
> Thanks!
> Mike
>
> On 8/22/16, 12:43 AM, "Tutkowski, Mike"  wrote:
>
>I can try that. Thanks, Rajani!
>
>> On Aug 22, 2016, at 12:17 AM, Rajani Karuturi  wrote:
>>
>> Did you build and run it with noredist option?
>>
>> I see this CNF error when I forget to run jetty with noredist
>> option.
>>
>> ~ Rajani
>> http://cloudplatform.accelerite.com/
>>
>> On August 18, 2016 at 7:57 PM, Tutkowski, Mike
>> (mike.tutkow...@netapp.com) wrote:
>> Based on the error message of not being able to find the
>> PremiumSecondaryStorageResource class, this seems to be the
>> following error (#9 on this
>> page:
https://cwiki.apache.org/confluence/display/CLOUDSTACK/SSVM,+templates,+Secondary+storage+troubleshooting
):
>>
>> SSVM agent not running - You see error something like below. Most
>> probably your systemvm didnt get patched with the agent specific
>> code. This patching happens through the ISO - something
>> like systemvm***.iso. Check the size and location of the iso and
>> whether you are not using the old version iso. For XS its on the
>> host so grep for it and for vmware its on secondary storage. Do
>> also check that if its vmware that you built your ssvm using
>> noredist flag for mvn command. For more information check
>> SystemVm.iso
>> 2013-12-20 13:35:12,954 DEBUG [cloud.utils.ProcessUtil]
>> (main:null) Execution is successful.
>> 2013-12-20 13:35:12,960 ERROR [cloud.agent.AgentShell]
>> (main:null) Unable to start agent: Resource class not found:
>> com.cloud.storage.resource.PremiumSecondaryStorageResource due
>> to: java.lang.ClassNotFoundException:
>> com.cloud.storage.resource.PremiumSecondaryStorageResource
>>
>> I do see the ISO, though, on secondary storage here:
>>
>> cloudstack@cloudstack-virtual-machine:/export/secondary/systemvm$
>> ls -l
>> total 83420
>> -rw-rw-r-- 1 cloudstack cloudstack 85420032 Aug 15 16:10
>> systemvm-4.10.0-SNAPSHOT.iso
>> 
>> From: Tutkowski, Mike 
>> Sent: Thursday, August 18, 2016 8:17 AM
>> To: dev@cloudstack.apache.org
>> Subject: Re: Issue with SSVM on KVM on master
>>
>> In /var/log/cloud/cloud.out, I see the following repeated over
>> and over again (below).
>>
>> I'm running version 4.10.0 of the management server (but the
>> implementation version of the agent looks to be 4.9.0). I do have
>> systemvm-4.10.0-SNAPSHOT.iso accessible at
>> /export/secondary/systemvm (/export/secondary is my one and only
>> secondary storage at the time being).
>>
>> 2016-08-18 14:03:43,633 INFO [cloud.agent.AgentShell]
>> (main:null) Agent started
>> 2016-08-18 14:03:43,637 INFO [cloud.agent.AgentShell]
>> (main:null) Implementation Version is 4.9.0
>> 2016-08-18 14:03:43,637 INFO [cloud.agent.AgentShell]
>> (main:null) agent.properties found at
>> /usr/local/cloud/systemvm/conf/agent.properties
>> 2016-08-18 14:03:43,643 DEBUG [cloud.agent.AgentShell]
>> (main:null) Found property: instance
>> 2016-08-18 14:03:43,643 DEBUG [cloud.agent.AgentShell]
>> (main:null) Found property: resource
>> 2016-08-18 14:03:43,643 INFO [cloud.agent.AgentShell]
>> (main:null) Defaulting to using properties file for storage
>> 2016-08-18 14:03:43,645 INFO [cloud.agent.AgentShell]
>> (main:null) Defaulting to the constant time backoff algorithm
>> 2016-08-18 14:03:43,666 INFO [cloud.utils.LogUtils] (main:null)
>> log4j configuration found at
>> /usr/local/cloud/systemvm/conf/log4j-cloud.xml
>> 2016-08-18 14:03:43,686 INFO [cloud.agent.AgentShell]
>> (main:null) Using default Java settings for IPv6 preference for
>> agent connection
>> 2016-08-18 14:03:43,687 DEBUG [cloud.agent.AgentShell]
>> (main:null) Checking to see if agent.SecStorage.pid exists.
>> 2016-08-18 14:03:43,694 DEBUG [cloud.utils.ProcessUtil]
>> (main:null) environment.properties could not be opened
>> 

Re: Hiding buttons based on role

[Frank Maximus]

Filters on action are already used for vm's.
See vmActionfilter in instances.js.
Also for the sections I can find a sectionPreFilter in cloudStack.js
That seems to check the response of listCapabilities for
'allowusercreateprojects'.

Kind Regards,
Frank



*Frank Maximus *

Senior Software Development Engineer



*nuage*networks.net
​Copernicuslaan 50

2018 Antwerp

Belgium



p: +32 3 240 73 81


On Fri, Aug 19, 2016 at 1:41 AM, Marty Godsey <ma...@gonsource.com> wrote:

> That would be great. I think adding the ability hide GUI elements based on
> role inside the GUI would be a great step.
>
> Regards,
> Marty Godsey
>
> -Original Message-
> From: Rashmi Dixit [mailto:rashmi_di...@accelerite.com]
> Sent: Thursday, August 18, 2016 8:15 AM
> To: dev@cloudstack.apache.org
> Subject: RE: Hiding buttons based on role
>
> Hi Marty,
>
> We could add an "actionPreFilter" for "actions" defined in the widgets
> which will filter out the buttons based on role.
>
> There are preFilters already implemented for fields in a listView - we
> need to follow the same principle. We need to check for this filter where
> the buttons are built in the listView (look for "if (listViewData.actions)
> {" in listView.js).
>
> Hope this helps!
> Rashmi
>
>
>
> -Original Message-
> From: Marty Godsey [mailto:ma...@gonsource.com]
> Sent: Thursday, August 18, 2016 6:04 AM
> To: dev@cloudstack.apache.org
> Subject: RE: Hiding buttons based on role
>
> Not elegant but will work. This is not a one off to a degree. It's for my
> own servers but I will have at least 10-20 management server across the
> country in different zones  but this allows me to "hide" some elements that
> won't be used until a more elegant way is created/available.
>
> Thank you for the direction Will.
>
> Regards,
> Marty Godsey
>
> -Original Message-
> From: Will Stevens [mailto:williamstev...@gmail.com]
> Sent: Wednesday, August 17, 2016 8:29 PM
> To: dev@cloudstack.apache.org
> Subject: RE: Hiding buttons based on role
>
> If I was doing a one off solution for my own use case with a limited
> scope, I would do it he following.
>
> Apply a CSS class to the  tag which corresponds to the role. Then I
> would use CSS to 'display:none' on the elements you want to turn off by
> referencing the body role class (and keep the permissions applied so if
> they unhide it won't work).
>
> It is not an elegant solution, but it will work.
>
> On Aug 17, 2016 8:19 PM, "Marty Godsey" <ma...@gonsource.com> wrote:
>
> >
>
> > Ok. Thank you.
> >
> > I think for the time being I will enable all the project APIs again
> > but
> deny access to create a project.. this way at least he API errors on page
> load go away.
> >
> > This is something I think would be nice to have in the permissions
> > area
> now since we have granular rules. A way to "turn off" certain areas of the
> GUI and/or ACS functionality.
> >
> > Regards,
> > Marty Godsey
> >
> > -Original Message-
> > From: Will Stevens [mailto:williamstev...@gmail.com]
> > Sent: Wednesday, August 17, 2016 8:10 PM
> > To: dev@cloudstack.apache.org
> > Subject: RE: Hiding buttons based on role
> >
> > Yes. Most of the UI is built using huge json structures. These will
> > need
> to be adapted to account for a user's role. I don't think there has been
> work done on that yet, but I could be wrong.
> >
> > @rohit, do you know if anyone has looked into this at all yet?
> >
> > On Aug 17, 2016 7:41 PM, "Marty Godsey" <ma...@gonsource.com> wrote:
> >
> > > With that being said, we are now getting into the area of UI
> > > modification to hide the button huh?
> > >
> > > Regards,
> > > Marty Godsey
> > >
> > > -Original Message-
> > > From: Will Stevens [mailto:williamstev...@gmail.com]
> > > Sent: Wednesday, August 17, 2016 7:23 PM
> > > To: dev@cloudstack.apache.org
> > > Subject: Re: Hiding buttons based on role
> > >
> > > My understanding is that the permissions can be set, but they
> > > currently do not modify the UI in any way. I believe what you are
> > > experiencing is the expected behavior.
> > >
> > > Cheers,
> > >
> > > Will
> > >
> > > On Aug 17, 2016 6:47 PM, "Marty Godsey" <ma...@gonsource.com> wrote:
> > >
> > > > Is it possible to hide a button based upon a role? As an example I
> > > > want to hide and deny

Please add me to Jira Contributors List

[Frank Maximus]

Hi,

I want to assign a jira issue I created to myself.
Can my account *fmaximus* be added to the contributors list.

Thanks in advance,



*Frank Maximus *

Senior Software Development Engineer

*nuage*networks.net

Re: Better way to do development for SSVM agent code

[Frank Maximus]

You can also run the agent inside the management server, by changing the
advanced setting secondary.storage.vm to false.

That way no secondary storage vm will be used.

Regards,
Frank
On 9 Dec 2015 22:21, "Syed Mushtaq"  wrote:

> Hi,
>
> I've been working on a couple of fixes on the Swift integration which
> primarily involves changes on the agent that runs on the secondary storage
> VM. For every change that I do, I have to rebuild the systemvm profile and
> blow up my secondary storage VM for it to pick up my new code. Natrually,
> this is very time consuming and annoying. If you guys know of a faster way
> to develop/deploy the agent onto SSVM, please do tell.
>
> Thanks,
> -Syed
>

[j.bac.o] Job configurations

[Frank Maximus]

Hi,

I want to set up a jenkins server,
and would to copy jobs from jenkins.buildacloud.org.
I'm interested to get either the job config files,
or a read-only account on jenkins,

Thanks In Avdance,
Frank



*Frank Maximus *

Senior Software Development Engineer



*nuage*networks.net
​Copernicuslaan 50

2018 Antwerp

Belgium



p: +32 3 240 73 81

Re: Nexus repository dependencies

[Frank Maximus]

HI,

If you take a look into plugins/network-elements/junipercontrail/pom.xml,
you will see that a repository is defined there:
  

  juniper-contrail
  http://juniper.github.io/contrail-maven/snapshots

  

If you use maven mirror for all repositories, you will need to define the
juniper-contrail repo in nexus too.
Same will apply for kvm and midonet.

Kind Regards,
Frank

On Sun, Nov 1, 2015 at 6:53 PM, Ramzi Youssefi <ryouss...@gmail.com> wrote:

> Hi,
>
> I was trying to use Nexus as a local repository for cloudstack deployment.
> Everything went fine until this happened:
>
> [WARNING] The POM for
> net.juniper.contrail:juniper-contrail-api:jar:1.0-SNAPSHOT is missing, no
> dependency information available
>
> I have tried everything to make it work but it doesn't.
> Does some of you have experience in this field?
>
> For more information, please see this thread:
>
>
> http://stackoverflow.com/questions/33463410/maven-nexus-could-not-resolve-juniper-contrail-api
>
> Best regards,
> --
> Ramzi Youssefi
> Görlitzer Str. 49
> 01099 Dresden, Germany.
> Cell: +49 173 1965465
> Email: ryouss...@gmail.com
>


--
Frank Maximus
*nuage*networks.net
Antwerp, Belgium

Re: TransactionContextInterceptor Keeps Releasing My Lock

[Frank Maximus]

Would you happen to call the method annotated with @DB from within the same
class? If so,  you would directly go to the method, instead of using the
proxy which applies AOP.

Regards,
Frank
On 26 Oct 2015 12:53, "Jeff Hair"  wrote:

> I have narrowed it down to multithreading being the cause. I have a set of
> workers running through an executor service, and it seems cglib is not
> respecting the @DB annotation on the method being called by the thread.
>
> I can force the lock to be acquired if the entire method is executed in a
> transaction, or if I remove the producer-consumer BlockingQueue. Is there a
> way that makes sense besides one of these two options?
>
> On Wed, Oct 14, 2015 at 5:04 PM, Jeff Hair  wrote:
>
> > I'm using the DAO API to create a lock in the lock table as per
> > https://cwiki.apache.org/confluence/display/CLOUDSTACK/Data+Access+Layer
> .
> > However, the lock seems to mysteriously vanish after acquireInLockTable
> or
> > lockInLockTable method returns. Looking at the code, I've discovered that
> > TransactionContextInterceptor is closing the TransactionLegacy after the
> > method returns.
> >
> > I have @DB on the method calling acquireFromLockTable. What am I doing
> > wrong?
> >
>
>
>
> --
> *Jeff Hair*
> Technical Lead and Software Developer
>
> Tel: (+354) 415 0200
> j...@greenqloud.com
> www.greenqloud.com
>

Re: Unable to compile 4.5 branch

[Frank Maximus]

Mvn.skip.tests=true will skip building the test jar. Running without that
option should work.

Regards,
Frank
Apologies, sent that too early, last bit should be :

Apache Maven 3.0.4 (r1232337; 2012-01-17 08:44:56+)
Maven home: /usr/local/apache-maven-3.0.4
Java version: 1.7.0_75, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.75.x86_64/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "2.6.32-504.12.2.el6.x86_64", arch: "amd64",
family: "unix"

Thanks!


On Sat, Oct 10, 2015 at 4:00 PM, cs user  wrote:

> Hi Folks,
>
> I'd really appreciate some help with this if anyone can spare a moment
> :-)
>
> So I've checked out the repo and got to this stage in git:
>
> [csuser@localhost cloudstack]$ git status
> # On branch origin/4.5
> nothing to commit (working directory clean)
>
> I've then done a mvn clean, and all is fine.
>
> I've then tried to compile with the following command:
>
> [csuser@localhost cloudstack]$ mvn -U -P impatient,developer
> -Dmaven.test.skip=true -DskipTests
>
> However I keep getting the following:
>
> [INFO] Building Apache CloudStack Framework - Clustering 4.5.3-SNAPSHOT
> [INFO]
> 
> Downloading:
>
http://repository.apache.org/snapshots/org/apache/cloudstack/cloud-api/4.5.3-SNAPSHOT/maven-metadata.xml
> Downloading:
>
http://repository.apache.org/snapshots/org/apache/cloudstack/cloud-api/4.5.3-SNAPSHOT/cloud-api-4.5.3-SNAPSHOT-tests.jar
> SNIP
> [ERROR] Failed to execute goal on project cloud-framework-cluster: Could
> not resolve dependencies for project
> org.apache.cloudstack:cloud-framework-cluster:jar:4.5.3-SNAPSHOT: Could
not
> find artifact org.apache.cloudstack:cloud-api:jar:tests:4.5.3-SNAPSHOT in
> apache.snapshots (http://repository.apache.org/snapshots) -> [Help 1]
>
>
> This cloud-api-4.5.3-SNAPSHOT-tests.jar it mentions doesn't appear to
> exist in the location it is trying to download it from. Just to note, I do
> seem to be able to compile the master branch (4.6). That compiles and then
> launches fine.
>
> Is there a way around this issue for the 4.5 branch?
>
> mvn -v shows:
>
>
>
>