Re: Review Request 27017: CLOUDSTACK-6282: Added newly automated tests and also modified some existing tests to remove dependency

2014-11-24 Thread Alex Brett

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27017/#review62786
---

Ship it!


Ship It!

- Alex Brett


On Nov. 3, 2014, 6:19 a.m., Vinay Varma wrote:
 
 ---
 This is an automatically generated e-mail. To reply, visit:
 https://reviews.apache.org/r/27017/
 ---
 
 (Updated Nov. 3, 2014, 6:19 a.m.)
 
 
 Review request for cloudstack, Alex Brett and Santhosh Edukulla.
 
 
 Bugs: CLOUDSTACK-6282
 https://issues.apache.org/jira/browse/CLOUDSTACK-6282
 
 
 Repository: cloudstack-git
 
 
 Description
 ---
 
 CLOUDSTACK-6282: Added newly automated tests and also modified some existing 
 tests to remove dependency
 
 
 Diffs
 -
 
   test/integration/component/test_escalations_instances.py 1aaa688 
   test/integration/component/test_escalations_snapshots.py 4b6b7f5 
   test/integration/component/test_escalations_templates.py 78028bc 
   test/integration/component/test_escalations_volumes.py 7290325 
   test/integration/component/test_escalations_vpncustomergateways.py b09930a 
   tools/marvin/marvin/cloudstackTestClient.py ce7ffc9 
   tools/marvin/marvin/lib/base.py 77faeeb 
   tools/marvin/marvin/lib/utils.py b58b59d 
 
 Diff: https://reviews.apache.org/r/27017/diff/
 
 
 Testing
 ---
 
 Attached are the results files for each of the file modified and the results 
 shows everything is fine
 
 
 File Attachments
 
 
 Instancesresults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/10/22/6ea95260-f31e-4fdd-a9f3-f30bac872df5__Instancesresults.txt
 Snapshotsresults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/10/22/a91e862c-dc2e-403e-85e4-6479eefcd9d1__Snapshotsresults.txt
 Templatesresults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/10/22/545fd06e-4975-4330-8390-3723d944ec2b__Templatesresults.txt
 Voumesresults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/10/22/9932b16c-684f-41ce-b6f9-192fe887c2b8__Voumesresults.txt
 VPNCustomerGatewaysresults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/10/22/58c5f08e-cac7-4873-a922-8c874a9a8e3a__VPNCustomerGatewaysresults.txt
 
 
 Thanks,
 
 Vinay Varma
 




Re: Review Request 27017: CLOUDSTACK-6282: Added newly automated tests and also modified some existing tests to remove dependency

2014-10-31 Thread Alex Brett

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27017/#review59327
---



test/integration/component/test_escalations_instances.py
https://reviews.apache.org/r/27017/#comment100591

Is this supposed to be commented out (in which case it should probably just 
be removed), or is this leftover from debugging?



test/integration/component/test_escalations_instances.py
https://reviews.apache.org/r/27017/#comment100592

It might be better to put this function in Marvin as a library function for 
other tests?



test/integration/component/test_escalations_snapshots.py
https://reviews.apache.org/r/27017/#comment100593

This looks almost identical to the previous one (other than obviously 
grabbing memory), would it be worth having these methods call a shared method 
with just a parameter as to whether to include memory or not, to avoid code 
duplication?

(The risk is someone fixes a bug in one, but not the other or whatever)


- Alex Brett


On Oct. 31, 2014, 4:37 a.m., Vinay Varma wrote:
 
 ---
 This is an automatically generated e-mail. To reply, visit:
 https://reviews.apache.org/r/27017/
 ---
 
 (Updated Oct. 31, 2014, 4:37 a.m.)
 
 
 Review request for cloudstack, Alex Brett and Santhosh Edukulla.
 
 
 Bugs: CLOUDSTACK-6282
 https://issues.apache.org/jira/browse/CLOUDSTACK-6282
 
 
 Repository: cloudstack-git
 
 
 Description
 ---
 
 CLOUDSTACK-6282: Added newly automated tests and also modified some existing 
 tests to remove dependency
 
 
 Diffs
 -
 
   test/integration/component/test_escalations_instances.py 1aaa688 
   test/integration/component/test_escalations_snapshots.py 4b6b7f5 
   test/integration/component/test_escalations_templates.py 78028bc 
   test/integration/component/test_escalations_volumes.py 7290325 
   test/integration/component/test_escalations_vpncustomergateways.py b09930a 
   tools/marvin/marvin/cloudstackTestClient.py ce7ffc9 
   tools/marvin/marvin/lib/base.py 77faeeb 
 
 Diff: https://reviews.apache.org/r/27017/diff/
 
 
 Testing
 ---
 
 Attached are the results files for each of the file modified and the results 
 shows everything is fine
 
 
 File Attachments
 
 
 Instancesresults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/10/22/6ea95260-f31e-4fdd-a9f3-f30bac872df5__Instancesresults.txt
 Snapshotsresults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/10/22/a91e862c-dc2e-403e-85e4-6479eefcd9d1__Snapshotsresults.txt
 Templatesresults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/10/22/545fd06e-4975-4330-8390-3723d944ec2b__Templatesresults.txt
 Voumesresults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/10/22/9932b16c-684f-41ce-b6f9-192fe887c2b8__Voumesresults.txt
 VPNCustomerGatewaysresults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/10/22/58c5f08e-cac7-4873-a922-8c874a9a8e3a__VPNCustomerGatewaysresults.txt
 
 
 Thanks,
 
 Vinay Varma
 




Review Request 26760: Skip various BVT tests on LXC

2014-10-15 Thread Alex Brett

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26760/
---

Review request for cloudstack, Santhosh Edukulla and SrikanteswaraRao Talluri.


Bugs: CLOUDSTACK-7727
https://issues.apache.org/jira/browse/CLOUDSTACK-7727


Repository: cloudstack-git


Description
---

A number of BVT tests are not valid for LXC (e.g. migrating a VM), so this 
patch ensures they skip if LXC is in use.

LXC restrictions taken from 
https://cwiki.apache.org/confluence/display/CLOUDSTACK/LXC+Enhancements


Diffs
-

  test/integration/smoke/test_primary_storage.py 0813d28 
  test/integration/smoke/test_scale_vm.py 0b770c4 
  test/integration/smoke/test_snapshots.py 5db3e40 
  test/integration/smoke/test_templates.py db938d9 
  test/integration/smoke/test_vm_life_cycle.py 0be518d 
  test/integration/smoke/test_vm_snapshots.py dae945c 

Diff: https://reviews.apache.org/r/26760/diff/


Testing
---

Run all changed files against LXC and ensured appropriate tests skipped.


Thanks,

Alex Brett



Re: Review Request 25266: Simulator build support need to extends for RPM build

2014-10-13 Thread Alex Brett


 On Oct. 8, 2014, 5:07 p.m., Frank Zhang wrote:
  Ship It!

Unfortunately what's actually been pushed in 
https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=commit;h=f96c65416a2802bcf2a1f8d5a5070ffe6a29111f
 is missing a rather crucial change - in package.sh while it now takes the 
simulator argument, it doesn't actually pass it on to the rpmbuild command, 
i.e. this part of the diff has been missed:

```
-(cd $RPMDIR; rpmbuild --define _topdir $RPMDIR ${DEFVER} ${DEFREL} 
${DEFPRE+${DEFPRE}} ${DEFOSSNOSS+$DEFOSSNOSS} ${DOS} -bb SPECS/cloud.spec)
+(cd $RPMDIR; rpmbuild --define _topdir $RPMDIR ${DEFVER} ${DEFREL} 
${DEFPRE+${DEFPRE}} ${DEFOSSNOSS+$DEFOSSNOSS} ${DEFSIM+$DEFSIM} ${DOS} 
-bb SPECS/cloud.spec)
```


- Alex


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/25266/#review55820
---


On Sept. 19, 2014, 7:17 p.m., Rayees Namathponnan wrote:
 
 ---
 This is an automatically generated e-mail. To reply, visit:
 https://reviews.apache.org/r/25266/
 ---
 
 (Updated Sept. 19, 2014, 7:17 p.m.)
 
 
 Review request for cloudstack, Frank Zhang and Hugo Trippaers.
 
 
 Bugs: CLOUDSTACK-7469
 https://issues.apache.org/jira/browse/CLOUDSTACK-7469
 
 
 Repository: cloudstack-git
 
 
 Description
 ---
 
 Currently there is no option to build rpm with simulator,  as part this patch 
 modified package.sh file to accept simulator
 
 also updated cloud.spec file to build both oss and nooss simulator buids
 
 
 To build noredist and simulator, you need to use below package command
 ./package.sh --pack noredist --s simulator
 
 default package with simulato, need to call  ./package.sh
 
 
 Diffs
 -
 
   packaging/centos63/cloud.spec 7306d1f 
   packaging/centos63/package.sh 6a2d168 
 
 Diff: https://reviews.apache.org/r/25266/diff/
 
 
 Testing
 ---
 
 Yes
 
 
 File Attachments
 
 
 0001-Simulator-build-support-for-RPM-builds.patch
   
 https://reviews.apache.org/media/uploaded/files/2014/09/19/2537284e-f1de-419a-b5b6-66b8ddfcac84__0001-Simulator-build-support-for-RPM-builds.patch
 
 
 Thanks,
 
 Rayees Namathponnan
 




Review Request 26364: CLOUDSTACK-7673 Handle multiple gateways in test_ssvm.py

2014-10-06 Thread Alex Brett

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26364/
---

Review request for cloudstack and SrikanteswaraRao Talluri.


Bugs: CLOUDSTACK-7673
https://issues.apache.org/jira/browse/CLOUDSTACK-7673


Repository: cloudstack-git


Description
---

In some situations (e.g. EIP) listVlanRanges can return multiple entries,
however the checks in test_ssvm.py were only ever looking at the first result,
therefore these tests could incorrectly fail.

Modify the check to look at all returned gateways for a match


Diffs
-

  test/integration/smoke/test_ssvm.py 5713569 

Diff: https://reviews.apache.org/r/26364/diff/


Testing
---

Verified the tests pass in a normal scenario


Thanks,

Alex Brett



RE: Shellshock

2014-10-03 Thread Alex Brett
On 03 October 2014 13:52, Adrian Lewis [adr...@alsiconsulting.co.uk] wrote:
 The only solution I can think of is to 'apt-get update bash' on every
 system VM but clearly these get fired up dynamically. Is it possible to
 boot the template, make modifications and then use as a replacement system
 VM? Are there processes that happen on boot that only happen once and
 therefore need resetting to recreate the template?

This isn't a quick fix, so not suitable for this specific issue, but something 
I've wondered for a while is rather than keep having to build new system VM 
templates for every small change, would we be better integrating a tool such as 
Puppet / Chef, so we can bring a system VM 'up to date' when it boots, as long 
as it's the right 'base'.

What I'm thinking here (using Puppet terminology as that's what I'm familiar 
with, but could be any similar mechanism or even just a simple script) is when 
the system VM loads up, it connects to the management server and retrieves a 
manifest, which it then applies. That manifest would specify:
 - Packages to update (including if necessary any apt/yum repo information)
 - Config files to put in place
 - Anything else required like starting any services etc

While it would slightly delay the boot process, it would ensure that on e.g. 
upgrade, you don't have to immediately replace your system VM template unless a 
substantial change (e.g. base system VM distro / partition layout) has been 
made. You could still bring in an updated template to speed things up, but it 
would be far less urgent to do so...

Any thoughts on this anybody?

Alex


Re: Review Request 24882: CLOUDSTACK-6282 - Added skip condition when hypervisor is hyper-v for tests which are not applicable for hyper-v

2014-09-29 Thread Alex Brett

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24882/#review54798
---



test/integration/component/test_escalations_instances.py
https://reviews.apache.org/r/24882/#comment95069

Minor one but where we're checking multiple hypervisors to skip I'd have 
done e.g. if self.hypervisor.lower() in ['kvm', 'hyperv']: or similar rather 
than have two separate ifs...



test/integration/component/test_escalations_isos.py
https://reviews.apache.org/r/24882/#comment95074

You don't need this as you've already got above:
from marvin.lib.utils import *


- Alex Brett


On Sept. 29, 2014, 7:13 a.m., Vinay Varma wrote:
 
 ---
 This is an automatically generated e-mail. To reply, visit:
 https://reviews.apache.org/r/24882/
 ---
 
 (Updated Sept. 29, 2014, 7:13 a.m.)
 
 
 Review request for cloudstack and Santhosh Edukulla.
 
 
 Bugs: CLOUDSTACK-6282
 https://issues.apache.org/jira/browse/CLOUDSTACK-6282
 
 
 Repository: cloudstack-git
 
 
 Description
 ---
 
 CLOUDSTACK-6282 - Added skip condition when hypervisor is hyper-v for tests 
 which are not applicable for hyper-v
 
 
 Diffs
 -
 
   test/integration/component/test_escalations_instances.py 73ebf13 
   test/integration/component/test_escalations_ipaddresses.py b29cd1d 
   test/integration/component/test_escalations_isos.py 925c2fb 
   test/integration/component/test_escalations_networks.py c0ab709 
   test/integration/component/test_escalations_snapshots.py 8d289e1 
   test/integration/component/test_escalations_volumes.py 8d6ba99 
 
 Diff: https://reviews.apache.org/r/24882/diff/
 
 
 Testing
 ---
 
 Executed the tests and attached are the log files for each of the files 
 changed.
 
 
 File Attachments
 
 
 InstancesResults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/08/20/4ac84a27-fc7c-4b8c-9509-d75a350b53a3__InstancesResults.txt
 IPAddressesResults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/08/20/14aad713-9256-44ed-a9e2-d7225c5c975c__IPAddressesResults.txt
 IsoResults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/08/20/516de1c8-09d0-4e07-abe4-3483463750c3__IsoResults.txt
 SnapshotsResults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/08/20/46f2a6c3-f0f7-4397-918e-bb8df1d63e97__SnapshotsResults.txt
 VolumeResults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/08/20/28d59100-315b-45e8-9aaa-b60982571637__VolumeResults.txt
 NetworksResults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/08/20/869b26e2-9fc2-44cf-bbc1-fc13fd60bc58__NetworksResults.txt
 
 
 Thanks,
 
 Vinay Varma
 




[BLOCKED] Management server not starting

2014-09-24 Thread Alex Brett
The management server is not starting on current master builds - apparently due 
to a DB error.

https://issues.apache.org/jira/browse/CLOUDSTACK-7621 has been filed for this, 
CCing Pierre-Luc Dion as the author of some DB schema changes that are 
potential candidates for causing the problem...

Alex


RE: Marvin test cleanup

2014-09-10 Thread Alex Brett
 I like the idea. What worries me is the possibility to run test cases on a 
 life
 system. I think it is useful for some operators to be able to do that.
 Those people must not lose any objects that were created outside of the
 test suite. Therefore it can be very tricky, not very different from your
 parallel use-case, though.

I'd only be looking to remove objects created by the specific test case, so 
that should be fine. If it ended up deleting other objects it would as you say 
break the parallel use case so I definitely won't be looking to do that.

I'll make a start on this over the next few days and see what I can get 
working...

Alex


RE: [DISCUSS] How xs-tools gets installed for xen vms and systemvms

2014-09-09 Thread Alex Brett
On essentially any current Linux distro, xs-tools doesn't actually install any 
drivers (in the days of RHEL4 and the like it used to have custom kernels as 
the vendor ones had severe limitations), because as you say the kernel has the 
support built in (PVops).

What xs-tools gives in Linux is:
 - Reporting of the VM distro etc back to the toolstack
 - In guest memory usage reporting back to the toolstack
 - Installs some userspace xenstore tools

The XenServer toolstack does gate some VM operations on the presence of the 
tools, in particular migrate. This is somewhat historical (as the tools aren't 
doing any driver changes they don't actually affect whether the migrate would 
succeed or not, but when different kernels were required the presence of the 
agent gave an indication the correct kernel was in use, and it is shared code 
with Windows guests where you do need the drivers to migrate safely), and may 
be changed in future, but for now is a limitation.

In terms of versions, we should ideally always install one from the latest 
XenServer release, these should (though I'll need to do some tests to be 100% 
sure) work on older ones as well with no problems. Older ones will likely work 
properly on newer versions as well, though it will in some cases cause an out 
of date warning to appear in XenCenter, which could be worrying for users.

Alex


From: Pierre-Luc Dion [pd...@cloudops.com]
Sent: 09 September 2014 17:59
To: dev@cloudstack.apache.org
Subject: Re: [DISCUSS] How xs-tools gets installed for xen vms and systemvms

Hi Ian,  you are probably right about the PV driver of Debian 7, I can't
confirmed. But, the xs-tools also provide interesting ressources usage
metrics of VMs in XenServer. I think it is also required for xenmotion of
VMs for maintenance purposes.



Marvin test cleanup

2014-09-09 Thread Alex Brett
Hello all,

At the moment we have a lot of Marvin tests that follow a pattern that looks 
roughly like this:

1. Setup some resources (e.g. accounts, service offerings, VMs etc)
2. Add the resources to a list in the testcase (often called self.cleanup)
3. Do the test(s)
4. Call cleanup_resources with the list of resources from 2

(obviously in some cases resources get created/allocated during the actual test 
rather than in setup, but it's a similar principle)

In theory this is fine, however there are a number of cases where resources are 
being created and then not added to the cleanup list, which results in things 
being 'left behind', potentially using up resources which may then affect 
future tests. For example I'm currently attempting to run various tests in 
parallel (to speed up execution), and I'm hitting some issues I believe to be 
caused by this.

The thought that occurs to me here is do we actually need the testcase to have 
to manually add resources to a list to cleanup, with the inherent risk of 
resources getting missed etc - could we not make this something the framework 
does for us (at least by default, with the option to override the behaviour if 
needed).

I've got some ideas as to how this could be done (one example that's a bit of a 
layer violation but might be acceptable would be to wrap/extend the apiClient 
to have a method that can be called on it from the various object create 
methods to add the resulting object for cleanup), but before I go ahead and 
start trying to prototype something I wanted to see if anybody had any reasons 
why this sort of automatic cleanup behaviour might be a bad idea or has 
investigated anything similar in the past?

Cheers,
Alex



RE: test case tagging and travis output

2014-09-04 Thread Alex Brett
On 04 September 2014 15:14, Daan Hoogland [daan.hoogl...@gmail.com] wrote:
 It seems that CLOUDSTACK-6914 introduced some new tagging scheme for test
 and I am assuming the new tagging should exclude the test from the travis
 run (makes sense and trying now). The new tagging scheme is not documented
 in the bug in spite of Alex Brett asking for it, so once again:
 @anyone: is this described somewhere?

I'm not sure what exactly you're trying to achieve, but I've found what was 
done in CLOUDSTACK-6914 is limited as to what it can do - I've got a couple of 
reviews outstanding that could be relevant here which are:

CLOUDSTACK-7307 / https://reviews.apache.org/r/24552/
CLOUDSTACK-7322 / https://reviews.apache.org/r/24605/

Feel free to take a look and see if you agree with what they're trying to do...

Cheers,
Alex

Re: Review Request 25289: CLOUDSTACK-7474-Failed-to-start-MS-with-java7-version

2014-09-03 Thread Alex Brett


 On Sept. 3, 2014, 9:32 a.m., Rajani Karuturi wrote:
  client/tomcatconf/classpath.conf.in, line 37
  https://reviews.apache.org/r/25289/diff/1/?file=674877#file674877line37
 
  Can we get the JAVA_HOME from installed java instead of hardcoding it? 
  The path may be different for different os versions or distributions. 
  
  something similar to what we already did at 
  https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=commit;h=c468228fe807c621decc5919dadae9bcbb38c753
  
  May we should move this to a common file like setenv.sh and use it 
  everywhere.
 
 Frank Zhang wrote:
 +1
 
 Rayees Namathponnan wrote:
 Hi Rajani,
 
 I checked your change list, if your machine in running with default java 
 version is 1.6,  this will always return 1.6 and management server will fails 
 to start 
 
 
 Even usage sever will be an issue in 4.5, if your machine is runnign with 
 java1.6
 
 https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;a=blobdiff;f=packaging/centos63/cloud-usage.rc;h=8434e4d568a066d0766d055847725b1779eb33c4;hp=617037995755024a8c9d5e492bb56b7cc938e48f;hb=c468228fe807c621decc5919dadae9bcbb38c753;hpb=75c9a20c7773c268c02fb006d1a7820cb427c94c
 
 
 Regards,
 Rayees

To expand on this a little bit - in RHEL 6.3 if you have both Java 1.6 and Java 
7 installed, the default behaviour with the alternatives mechanism makes 1.6 
the default Java instance (you can manually set 1.7 as the default, but this is 
an extra step). This means that the management server / KVM agent then fail to 
work.

In 6.5 if you have both then by default Java 7 is used, and all works fine (not 
sure about 6.4 or 7, I've not tested them).


- Alex


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/25289/#review52151
---


On Sept. 3, 2014, 6:25 a.m., Rayees Namathponnan wrote:
 
 ---
 This is an automatically generated e-mail. To reply, visit:
 https://reviews.apache.org/r/25289/
 ---
 
 (Updated Sept. 3, 2014, 6:25 a.m.)
 
 
 Review request for cloudstack, Frank Zhang and Hugo Trippaers.
 
 
 Bugs: CLOUDSTACK-7474
 https://issues.apache.org/jira/browse/CLOUDSTACK-7474
 
 
 Repository: cloudstack-git
 
 
 Description
 ---
 
 Step 1: Deploy new RHEL 6.3 machine
 Step 2 : Install MS
 Step 3: run deploy script and start MS
 
 Result 
 
 Installation completed successfully,  both java7 and java got installed as 
 part of MS installation, but MS failed to start java version erro
 
 we need to load java7 while start MS
 
 
 Diffs
 -
 
   client/tomcatconf/classpath.conf.in 3ae0fb4 
 
 Diff: https://reviews.apache.org/r/25289/diff/
 
 
 Testing
 ---
 
 Yes
 
 
 Thanks,
 
 Rayees Namathponnan
 




Re: Review Request 24882: CLOUDSTACK-6282 - Added skip condition when hypervisor is hyper-v for tests which are not applicable for hyper-v

2014-09-03 Thread Alex Brett

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24882/#review52262
---



test/integration/component/test_escalations_ipaddresses.py
https://reviews.apache.org/r/24882/#comment91028

Is there a reason for making this change - getHypervisorInfo is generally 
what is used elsewhere rather than the hypervisor property of services?

(getHypervisorInfo has the benefit that if we ever need to start testing 
mixed clouds we can make sure it returns the type we want this particular test 
to run on, rather than the single value in services)



test/integration/component/test_escalations_isos.py
https://reviews.apache.org/r/24882/#comment91030

I don't see anything from cloudstackException or SshClient being used in 
this file - any reason to add imports for them?



test/integration/component/test_escalations_isos.py
https://reviews.apache.org/r/24882/#comment91027

Other things in the file use PASS from marvin.codes so this should still be 
imported.



test/integration/component/test_escalations_isos.py
https://reviews.apache.org/r/24882/#comment91026

This will break unless you change the existing usages of time.sleep to just 
sleep (personally I'd leave it as import time though).



test/integration/component/test_escalations_isos.py
https://reviews.apache.org/r/24882/#comment91031

Not your bug, but the wording here is poor - should probably be Not enough 
zones exist to copy iso or similar.


- Alex Brett


On Aug. 20, 2014, 4:22 a.m., Vinay Varma wrote:
 
 ---
 This is an automatically generated e-mail. To reply, visit:
 https://reviews.apache.org/r/24882/
 ---
 
 (Updated Aug. 20, 2014, 4:22 a.m.)
 
 
 Review request for cloudstack and Santhosh Edukulla.
 
 
 Bugs: CLOUDSTACK-6282
 https://issues.apache.org/jira/browse/CLOUDSTACK-6282
 
 
 Repository: cloudstack-git
 
 
 Description
 ---
 
 CLOUDSTACK-6282 - Added skip condition when hypervisor is hyper-v for tests 
 which are not applicable for hyper-v
 
 
 Diffs
 -
 
   test/integration/component/test_escalations_instances.py 1b72b2f 
   test/integration/component/test_escalations_ipaddresses.py 6c9b24b 
   test/integration/component/test_escalations_isos.py a0fa333 
   test/integration/component/test_escalations_networks.py 56f61b4 
   test/integration/component/test_escalations_snapshots.py af493a1 
   test/integration/component/test_escalations_volumes.py d1dae12 
 
 Diff: https://reviews.apache.org/r/24882/diff/
 
 
 Testing
 ---
 
 Executed the tests and attached are the log files for each of the files 
 changed.
 
 
 File Attachments
 
 
 InstancesResults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/08/20/4ac84a27-fc7c-4b8c-9509-d75a350b53a3__InstancesResults.txt
 IPAddressesResults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/08/20/14aad713-9256-44ed-a9e2-d7225c5c975c__IPAddressesResults.txt
 IsoResults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/08/20/516de1c8-09d0-4e07-abe4-3483463750c3__IsoResults.txt
 SnapshotsResults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/08/20/46f2a6c3-f0f7-4397-918e-bb8df1d63e97__SnapshotsResults.txt
 VolumeResults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/08/20/28d59100-315b-45e8-9aaa-b60982571637__VolumeResults.txt
 NetworksResults.txt
   
 https://reviews.apache.org/media/uploaded/files/2014/08/20/869b26e2-9fc2-44cf-bbc1-fc13fd60bc58__NetworksResults.txt
 
 
 Thanks,
 
 Vinay Varma
 




RE: Review Request 25289: CLOUDSTACK-7474-Failed-to-start-MS-with-java7-version

2014-09-03 Thread Alex Brett
On 04 September 2014 00:45, David Nalley [da...@gnsa.us] wrote:
 On Wed, Sep 3, 2014 at 7:40 PM, Alex Brett alex.br...@citrix.com wrote:
 To expand on this a little bit - in RHEL 6.3 if you have both Java 1.6 and 
 Java 7 installed, the default behaviour with the alternatives mechanism 
 makes 1.6 the default Java instance (you can manually set 1.7 as the 
 default, but this is an extra step). This means that the management server / 
 KVM agent then fail to work.

 In 6.5 if you have both then by default Java 7 is used, and all works fine 
 (not sure about 6.4 or 7, I've not tested them).


 Perhaps we add a Conflicts with java 1.6 - it would be somewhat ugly,
 and if you run into it  you would need to know to yum remove, but that
 would keep you from having an installation at all rather than
 expecting it to work and trying to debug.


I'd have thought this would prove problematic over upgrade - as you'd have a 
conflict that the new version would need to have 1.6 removed, but you can't do 
that without removing your old version first. There's also the issue of if the 
user wants to have both around for other tools they're running on the same 
machine.

Some solutions that don't break upgrade that I can see are:
* Rayees change in the review to point directly at Java 7, with the caveat that 
this might have some cross platform issues
* Somehow automating the alternatives mechanism, i.e. doing a check as part of 
management server startup somewhere that if the default Java is 1.6, setting it 
to be Java 7 (which we know should be installed by the RPM dependencies) - a 
little ugly as we are changing a user's default underneath them, and may also 
have cross platform issues
* Require use of 6.5 (or possibly 6.4 if the version that has works) instead of 
6.3 - we do already say to install all hotfixes etc, which in theory means 
people should be there (yum update / upgrade on a 6.3 system will make it 
6.5+), though I think we know in practise a lot of users aren't as they prefer 
to keep things at a stable state or only apply very specific updates. I guess 
this would be done by specifying a minimum Java version required that is only 
in the appropriate release or later.
* Don't actually block it in the RPM, but check in the init script what version 
of Java we're going to end up picking up, and if it's 1.6 fail with a clear 
error message suggesting the user changes the default - still means the 
management server / agent won't start after upgrade, but is at least a 
reasonably easy fix.

Alex

Review Request 25258: Fix TestVolumes.test_07_resize_fail

2014-09-02 Thread Alex Brett

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/25258/
---

Review request for cloudstack and Mike Tutkowski.


Bugs: CLOUDSTACK-7467
https://issues.apache.org/jira/browse/CLOUDSTACK-7467


Repository: cloudstack-git


Description
---

Previously if you had a volume using a non customisable disk offering, and
attempted to resize it passing in the same disk offering id, the command would
be accepted, but it would actually be resized to its current size (i.e. the
provided size parameter was ignored). This is what the test used to check.

Commit de6a3112b6b80952d1598acaa112ac50a3ef9d32 modified the logic to check if
the provided diskofferingid was the same as the current one, and if so treat it
as if it hadn't been provided - this means the resize command now fails, which
is probably the more sensible thing to do (rather than giving the impression it
will be resized but actually not doing so).

This change therefore modifies the test logic to match.


Diffs
-

  test/integration/smoke/test_volumes.py e2e0d76 

Diff: https://reviews.apache.org/r/25258/diff/


Testing
---

Test passed running against current build


Thanks,

Alex Brett



RE: [BLOCKED] Unable to connect to management server on current master builds

2014-08-31 Thread Alex Brett
This is still failing for me, but I think I've now found the exception that is 
actually showing the problem - it was hiding in localhost.date.log. I've 
pasted it on the ticket, but here it is as well:

Aug 30, 2014 11:10:50 PM org.apache.catalina.core.StandardContext listenerStart
SEVERE: Exception sending context initialized event to listener instance of 
class org.apache.cloudstack.spring.module.web.CloudStackContextLoaderListener
java.lang.NullPointerException
at java.util.ArrayList.addAll(ArrayList.java:530)
at 
com.cloud.api.auth.APIAuthenticationManagerImpl.getCommands(APIAuthenticationManagerImpl.java:72)
at 
com.cloud.api.auth.APIAuthenticationManagerImpl.start(APIAuthenticationManagerImpl.java:56)
at 
org.apache.cloudstack.spring.lifecycle.CloudStackExtendedLifeCycle$1.with(CloudStackExtendedLifeCycle.java:75)
at 
org.apache.cloudstack.spring.lifecycle.CloudStackExtendedLifeCycle.with(CloudStackExtendedLifeCycle.java:153)
at 
org.apache.cloudstack.spring.lifecycle.CloudStackExtendedLifeCycle.startBeans(CloudStackExtendedLifeCycle.java:72)
at 
org.apache.cloudstack.spring.lifecycle.CloudStackExtendedLifeCycleStart.run(CloudStackExtendedLifeCycleStart.java:46)
at 
org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet$1.with(DefaultModuleDefinitionSet.java:105)
at 
org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:245)
at 
org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:250)
at 
org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:250)
at 
org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:233)
at 
org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.startContexts(DefaultModuleDefinitionSet.java:97)
at 
org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.load(DefaultModuleDefinitionSet.java:80)
at 
org.apache.cloudstack.spring.module.factory.ModuleBasedContextFactory.loadModules(ModuleBasedContextFactory.java:37)
at 
org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.init(CloudStackSpringContext.java:70)
at 
org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.init(CloudStackSpringContext.java:57)
at 
org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.init(CloudStackSpringContext.java:61)
at 
org.apache.cloudstack.spring.module.web.CloudStackContextLoaderListener.contextInitialized(CloudStackContextLoaderListener.java:52)
at 
org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:3972)
at 
org.apache.catalina.core.StandardContext.start(StandardContext.java:4467)
at 
org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:791)
at 
org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:771)
at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:526)
at 
org.apache.catalina.startup.HostConfig.deployDirectory(HostConfig.java:1041)
at 
org.apache.catalina.startup.HostConfig.deployDirectories(HostConfig.java:964)
at 
org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:502)
at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1277)
at 
org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:321)
at 
org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:119)
at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053)
at org.apache.catalina.core.StandardHost.start(StandardHost.java:722)
at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1045)
at 
org.apache.catalina.core.StandardEngine.start(StandardEngine.java:443)
at 
org.apache.catalina.core.StandardService.start(StandardService.java:516)
at 
org.apache.catalina.core.StandardServer.start(StandardServer.java:710)
at org.apache.catalina.startup.Catalina.start(Catalina.java:593)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)

Alex


RE: [BLOCKED] Unable to connect to management server on current master builds

2014-08-31 Thread Alex Brett
Firstly just to confirm your workaround seems to have done the trick - I can 
now contact the management server again. Interestingly I don't see the log 
message your change added in APIAuthenticationManagerImpl.java if that means 
anything

In terms of Java versions, at runtime I'm using whatever the 1.7 JRE you get 
with RHEL 6.3 is - the build will be using whatever JDK 
http://jenkins.buildacloud.org/job/package-rhel63-master/ uses, as that's where 
I've been getting the ACS master builds from. I don't have access to that 
Jenkins instance beyond the public access to know what it's actually running 
etc.

Alex

 -Original Message-
 From: Rohit Yadav [mailto:rohit.ya...@shapeblue.com]
 Sent: 31 August 2014 18:43
 To: dev@cloudstack.apache.org
 Cc: Alex Brett
 Subject: Re: [BLOCKED] Unable to connect to management server on current
 master builds
 
 
 On 31-Aug-2014, at 5:07 pm, Rayees Namathponnan
 rayees.namathpon...@citrix.com wrote:
  Mostly Alex should be using java 1.7 only.
 
 I would advise to only use jdk 1.7 and try again with a clean environment
 with latest master. If it's failing for some reason check if any spring
 config/xmls were changed, it looks like a failed dependency injection which
 is causing it.
 
 Regards,
 Rohit Yadav
 Software Architect, ShapeBlue
 M. +41 779015219 | rohit.ya...@shapeblue.com
 Blog: bhaisaab.org | Twitter: @_bhaisaab
 
 
 
 Find out more about ShapeBlue and our range of CloudStack related
 services
 
 IaaS Cloud Design  Buildhttp://shapeblue.com/iaas-cloud-design-and-
 build//
 CSForge - rapid IaaS deployment
 frameworkhttp://shapeblue.com/csforge/
 CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/
 CloudStack Infrastructure Supporthttp://shapeblue.com/cloudstack-
 infrastructure-support/
 CloudStack Bootcamp Training Courseshttp://shapeblue.com/cloudstack-
 training/
 
 This email and any attachments to it may be confidential and are intended
 solely for the use of the individual to whom it is addressed. Any views or
 opinions expressed are solely those of the author and do not necessarily
 represent those of Shape Blue Ltd or related companies. If you are not the
 intended recipient of this email, you must neither take any action based
 upon its contents, nor copy or show it to anyone. Please contact the sender
 if you believe you have received this email in error. Shape Blue Ltd is a
 company incorporated in England  Wales. ShapeBlue Services India LLP is a
 company incorporated in India and is operated under license from Shape
 Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in
 Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty
 Ltd is a company registered by The Republic of South Africa and is traded
 under license from Shape Blue Ltd. ShapeBlue is a registered trademark.


RE: [BLOCKED] Unable to connect to management server on current master builds

2014-08-30 Thread Alex Brett
Logs on the CLOUDSTACK ticket below. The issue is that freshly installed 
management servers don't get to the stage if accepting API calls or presenting 
the UI - the startup just seems to stall...

Aled

From: Rohit Yadav [rohit.ya...@shapeblue.com]
Sent: 30 August 2014 11:16
To: Min Chen
Cc: dev@cloudstack.apache.org
Subject: Re: [BLOCKED] Unable to connect to management server on current master 
builds

Works for me, I’ll check the issue soon.

Can Alex or anyone else facing the issue sharing logs etc? If you were to use 
the APIs directly, what is the exception or issue observed?

On 30-Aug-2014, at 3:03 am, Min Chen min.c...@citrix.com wrote:

 CC Rohit here in case he didn't see this email.

 Rohit, can you fix this?

 Thanks
 -min

 On 8/29/14 9:21 AM, Alex Brett alex.br...@citrix.com wrote:

 Hello all,

 On current master builds (such as
 http://jenkins.buildacloud.org/job/package-rhel63-master/3202/), I can't
 connect to the management server, either via the API or UI.

 The major changes since the last working build I had seems to be the
 SAML2 merge (there are a couple of other things, but looking at those
 commits there doesn't appear to be much chance of them being the cause of
 the problem), so the SAML2 code would be where my suspicion lies.

 I've filed https://issues.apache.org/jira/browse/CLOUDSTACK-7455 for this
 with a log etc, but if someone familiar with the code (Rohit?) would mind
 looking at this and seeing if they could reproduce/fix, that would be
 good!

 Thanks,
 Alex


Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +41 779015219 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab



Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design  Buildhttp://shapeblue.com/iaas-cloud-design-and-build//
CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/
CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/
CloudStack Infrastructure 
Supporthttp://shapeblue.com/cloudstack-infrastructure-support/
CloudStack Bootcamp Training Courseshttp://shapeblue.com/cloudstack-training/

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England  Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.


RE: [BLOCKED] Unable to connect to management server on current master builds

2014-08-30 Thread Alex Brett
Also I note the last few simulator runs on jenkins.buildacloud.org are failing, 
the most recent with a SAML unit test failure...

Alex

From: Alex Brett [alex.br...@citrix.com]
Sent: 30 August 2014 12:39
To: dev@cloudstack.apache.org; Min Chen
Subject: RE: [BLOCKED] Unable to connect to management server on current master 
builds

Logs on the CLOUDSTACK ticket below. The issue is that freshly installed 
management servers don't get to the stage if accepting API calls or presenting 
the UI - the startup just seems to stall...

Aled

From: Rohit Yadav [rohit.ya...@shapeblue.com]
Sent: 30 August 2014 11:16
To: Min Chen
Cc: dev@cloudstack.apache.org
Subject: Re: [BLOCKED] Unable to connect to management server on current master 
builds

Works for me, I’ll check the issue soon.

Can Alex or anyone else facing the issue sharing logs etc? If you were to use 
the APIs directly, what is the exception or issue observed?

On 30-Aug-2014, at 3:03 am, Min Chen min.c...@citrix.com wrote:

 CC Rohit here in case he didn't see this email.

 Rohit, can you fix this?

 Thanks
 -min

 On 8/29/14 9:21 AM, Alex Brett alex.br...@citrix.com wrote:

 Hello all,

 On current master builds (such as
 http://jenkins.buildacloud.org/job/package-rhel63-master/3202/), I can't
 connect to the management server, either via the API or UI.

 The major changes since the last working build I had seems to be the
 SAML2 merge (there are a couple of other things, but looking at those
 commits there doesn't appear to be much chance of them being the cause of
 the problem), so the SAML2 code would be where my suspicion lies.

 I've filed https://issues.apache.org/jira/browse/CLOUDSTACK-7455 for this
 with a log etc, but if someone familiar with the code (Rohit?) would mind
 looking at this and seeing if they could reproduce/fix, that would be
 good!

 Thanks,
 Alex


Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +41 779015219 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab



Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design  Buildhttp://shapeblue.com/iaas-cloud-design-and-build//
CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/
CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/
CloudStack Infrastructure 
Supporthttp://shapeblue.com/cloudstack-infrastructure-support/
CloudStack Bootcamp Training Courseshttp://shapeblue.com/cloudstack-training/

This email and any attachments to it may be confidential and are intended 
solely for the use of the individual to whom it is addressed. Any views or 
opinions expressed are solely those of the author and do not necessarily 
represent those of Shape Blue Ltd or related companies. If you are not the 
intended recipient of this email, you must neither take any action based upon 
its contents, nor copy or show it to anyone. Please contact the sender if you 
believe you have received this email in error. Shape Blue Ltd is a company 
incorporated in England  Wales. ShapeBlue Services India LLP is a company 
incorporated in India and is operated under license from Shape Blue Ltd. Shape 
Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
registered by The Republic of South Africa and is traded under license from 
Shape Blue Ltd. ShapeBlue is a registered trademark.


RE: [BLOCKED] Unable to connect to management server on current master builds

2014-08-30 Thread Alex Brett
The job is 
http://jenkins.buildacloud.org/view/simulator/job/simulator-singlerun/239/ - 
I'm out the office today but in theory a BVT run should happen automatically so 
I'll try and check it later...

Alex

From: Rohit Yadav [rohit.ya...@shapeblue.com]
Sent: 30 August 2014 13:36
To: dev
Subject: Re: [BLOCKED] Unable to connect to management server on current master 
builds

Alex,


On 30-Aug-2014, at 1:45 pm, Alex Brett alex.br...@citrix.com wrote:
 Also I note the last few simulator runs on jenkins.buildacloud.org are 
 failing, the most recent with a SAML unit test failure…

Current build works for me, along with all unit tests.

Can you share a link to the build job where SAML unit tests are failing?

While I’m not sure what is causing the issue for you, I’ve pushed a minor fix 
on master that may cause a NPE for some cases and that irrespective of whether 
saml plugin is enabled the component return true on start().

Try if it works for you now.



 Alex
 
 From: Alex Brett [alex.br...@citrix.com]
 Sent: 30 August 2014 12:39
 To: dev@cloudstack.apache.org; Min Chen
 Subject: RE: [BLOCKED] Unable to connect to management server on current 
 master builds

 Logs on the CLOUDSTACK ticket below. The issue is that freshly installed 
 management servers don't get to the stage if accepting API calls or 
 presenting the UI - the startup just seems to stall...

 Aled
 
 From: Rohit Yadav [rohit.ya...@shapeblue.com]
 Sent: 30 August 2014 11:16
 To: Min Chen
 Cc: dev@cloudstack.apache.org
 Subject: Re: [BLOCKED] Unable to connect to management server on current 
 master builds

 Works for me, I’ll check the issue soon.

 Can Alex or anyone else facing the issue sharing logs etc? If you were to use 
 the APIs directly, what is the exception or issue observed?

 On 30-Aug-2014, at 3:03 am, Min Chen min.c...@citrix.com wrote:

 CC Rohit here in case he didn't see this email.

 Rohit, can you fix this?

 Thanks
 -min

 On 8/29/14 9:21 AM, Alex Brett alex.br...@citrix.com wrote:

 Hello all,

 On current master builds (such as
 http://jenkins.buildacloud.org/job/package-rhel63-master/3202/), I can't
 connect to the management server, either via the API or UI.

 The major changes since the last working build I had seems to be the
 SAML2 merge (there are a couple of other things, but looking at those
 commits there doesn't appear to be much chance of them being the cause of
 the problem), so the SAML2 code would be where my suspicion lies.

 I've filed https://issues.apache.org/jira/browse/CLOUDSTACK-7455 for this
 with a log etc, but if someone familiar with the code (Rohit?) would mind
 looking at this and seeing if they could reproduce/fix, that would be
 good!

 Thanks,
 Alex


 Regards,
 Rohit Yadav
 Software Architect, ShapeBlue
 M. +41 779015219 | rohit.ya...@shapeblue.com
 Blog: bhaisaab.org | Twitter: @_bhaisaab



 Find out more about ShapeBlue and our range of CloudStack related services

 IaaS Cloud Design  Buildhttp://shapeblue.com/iaas-cloud-design-and-build//
 CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/
 CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/
 CloudStack Infrastructure 
 Supporthttp://shapeblue.com/cloudstack-infrastructure-support/
 CloudStack Bootcamp Training 
 Courseshttp://shapeblue.com/cloudstack-training/

 This email and any attachments to it may be confidential and are intended 
 solely for the use of the individual to whom it is addressed. Any views or 
 opinions expressed are solely those of the author and do not necessarily 
 represent those of Shape Blue Ltd or related companies. If you are not the 
 intended recipient of this email, you must neither take any action based upon 
 its contents, nor copy or show it to anyone. Please contact the sender if you 
 believe you have received this email in error. Shape Blue Ltd is a company 
 incorporated in England  Wales. ShapeBlue Services India LLP is a company 
 incorporated in India and is operated under license from Shape Blue Ltd. 
 Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is 
 operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company 
 registered by The Republic of South Africa and is traded under license from 
 Shape Blue Ltd. ShapeBlue is a registered trademark.

Regards,
Rohit Yadav
Software Architect, ShapeBlue
M. +41 779015219 | rohit.ya...@shapeblue.com
Blog: bhaisaab.org | Twitter: @_bhaisaab



Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design  Buildhttp://shapeblue.com/iaas-cloud-design-and-build//
CSForge – rapid IaaS deployment frameworkhttp://shapeblue.com/csforge/
CloudStack Consultinghttp://shapeblue.com/cloudstack-consultancy/
CloudStack Infrastructure 
Supporthttp://shapeblue.com/cloudstack-infrastructure-support/
CloudStack Bootcamp Training Courseshttp

Review Request 25187: test_delete_account and test_releaseIP failing in advanced zone

2014-08-29 Thread Alex Brett

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/25187/
---

Review request for cloudstack, Ashutosh Kelkar and Santhosh Edukulla.


Bugs: CLOUDSTACK-7448
https://issues.apache.org/jira/browse/CLOUDSTACK-7448


Repository: cloudstack-git


Description
---

CLOUDSTACK-4840 changed test_data.py to make the lbrule publicport be 22,
instead of . In doing so, this caused the following tests to fail, as they
hit a problem where they tried to use port 22 for both the lbrule and for other
purposes:
integration.smoke.test_network.TestDeleteAccount.test_delete_account
integration.smoke.test_network.TestReleaseIP.test_releaseIP

The reason the change appears to have been made was that in
test_lb_secondary_ip.py, despite setting up the load balancer using lbrule, the
tests then used the SSH port from natrule to try and access the VM. By changing
lbrule to use port 22 (the same as natrule) this avoided the problem.

This patch updates test_lb_secondary_ip.py to use the SSH port in lbrule where
necessary to access the VMs, and reverts the change to test_data.py


Diffs
-

  test/integration/component/test_lb_secondary_ip.py f54caa6 
  tools/marvin/marvin/config/test_data.py fca2442 

Diff: https://reviews.apache.org/r/25187/diff/


Testing
---

Ran tests in test_lb_secondary_ip.py with changes in place, verified results 
equivalent to those seen on regular regression runs.
Ran test_delete_account and test_releaseIP to verify these now pass as expected.


Thanks,

Alex Brett



Unable to connect to management server on current master builds

2014-08-29 Thread Alex Brett
Hello all,

On current master builds (such as 
http://jenkins.buildacloud.org/job/package-rhel63-master/3202/), I can't 
connect to the management server, either via the API or UI.

The major changes since the last working build I had seems to be the SAML2 
merge (there are a couple of other things, but looking at those commits there 
doesn't appear to be much chance of them being the cause of the problem), so 
the SAML2 code would be where my suspicion lies.

I've filed https://issues.apache.org/jira/browse/CLOUDSTACK-7455 for this with 
a log etc, but if someone familiar with the code (Rohit?) would mind looking at 
this and seeing if they could reproduce/fix, that would be good!

Thanks,
Alex


Review Request 24805: CLOUDSTACK-7363 test_vmware_drs.py should skip on non-VMWare hypervisors

2014-08-18 Thread Alex Brett

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24805/
---

Review request for cloudstack and Santhosh Edukulla.


Bugs: CLOUDSTACK-7363
https://issues.apache.org/jira/browse/CLOUDSTACK-7363


Repository: cloudstack-git


Description
---

test_vmware_drs.py currently runs against any hypervisor, when it should only 
run against VMWare. This patch adds a check in setUpClass as to the hypervisor 
test, and will skip if VMWare is not in use.


Diffs
-

  test/integration/component/test_vmware_drs.py 7d3ab7f 

Diff: https://reviews.apache.org/r/24805/diff/


Testing
---

Tested against a XenServer cloud, and test correctly skipped.


Thanks,

Alex Brett



Re: Review Request 24550: CLOUDSTACK-7306 Don't run test_01_primary_storage_iscsi on KVM or HyperV

2014-08-13 Thread Alex Brett

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24550/
---

(Updated Aug. 13, 2014, 10:36 a.m.)


Review request for cloudstack and Santhosh Edukulla.


Changes
---

Updated patch that applies to current master following some other changes made 
in the same file...


Bugs: CLOUDSTACK-7306
https://issues.apache.org/jira/browse/CLOUDSTACK-7306


Repository: cloudstack-git


Description
---

test_01_primary_storage_iscsi in test/integration/smoke/test_primary_storage.py 
currently attempts to set up an iSCSI primary storage pool, regardless of the 
type of host.

For KVM, we only support iSCSI via shared mount point, and for Hyper-V we don't 
support it at all, so the test should skip in these cases.


Diffs (updated)
-

  test/integration/smoke/test_primary_storage.py d2d5b4f 

Diff: https://reviews.apache.org/r/24550/diff/


Testing
---

Ran test against KVM host to verify it skips correctly


Thanks,

Alex Brett



Re: Review Request 24550: CLOUDSTACK-7306 Don't run test_01_primary_storage_iscsi on KVM or HyperV

2014-08-13 Thread Alex Brett

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24550/
---

(Updated Aug. 13, 2014, 10:44 a.m.)


Review request for cloudstack and Santhosh Edukulla.


Changes
---

Additional update which removes a duplicated self.hypervisor declaration.


Bugs: CLOUDSTACK-7306
https://issues.apache.org/jira/browse/CLOUDSTACK-7306


Repository: cloudstack-git


Description
---

test_01_primary_storage_iscsi in test/integration/smoke/test_primary_storage.py 
currently attempts to set up an iSCSI primary storage pool, regardless of the 
type of host.

For KVM, we only support iSCSI via shared mount point, and for Hyper-V we don't 
support it at all, so the test should skip in these cases.


Diffs (updated)
-

  test/integration/smoke/test_primary_storage.py d2d5b4f 

Diff: https://reviews.apache.org/r/24550/diff/


Testing
---

Ran test against KVM host to verify it skips correctly


Thanks,

Alex Brett



Re: Review Request 24550: CLOUDSTACK-7306 Don't run test_01_primary_storage_iscsi on KVM or HyperV

2014-08-13 Thread Alex Brett


 On Aug. 13, 2014, 10:43 a.m., Santhosh Edukulla wrote:
  test/integration/smoke/test_primary_storage.py, line 158
  https://reviews.apache.org/r/24550/diff/2/?file=659231#file659231line158
 
  This check is not required right? As well, i just pushed a similar 
  change to master, post the ci failure. Please check.

Your change unfortunately was broken in that it was put into the *NFS* test 
(which is supported on KVM), not the iSCSI test, which isn't.

The most recent diff r4 I've done I believe resolves all of this...


- Alex


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24550/#review50441
---


On Aug. 13, 2014, 10:44 a.m., Alex Brett wrote:
 
 ---
 This is an automatically generated e-mail. To reply, visit:
 https://reviews.apache.org/r/24550/
 ---
 
 (Updated Aug. 13, 2014, 10:44 a.m.)
 
 
 Review request for cloudstack and Santhosh Edukulla.
 
 
 Bugs: CLOUDSTACK-7306
 https://issues.apache.org/jira/browse/CLOUDSTACK-7306
 
 
 Repository: cloudstack-git
 
 
 Description
 ---
 
 test_01_primary_storage_iscsi in 
 test/integration/smoke/test_primary_storage.py currently attempts to set up 
 an iSCSI primary storage pool, regardless of the type of host.
 
 For KVM, we only support iSCSI via shared mount point, and for Hyper-V we 
 don't support it at all, so the test should skip in these cases.
 
 
 Diffs
 -
 
   test/integration/smoke/test_primary_storage.py d2d5b4f 
 
 Diff: https://reviews.apache.org/r/24550/diff/
 
 
 Testing
 ---
 
 Ran test against KVM host to verify it skips correctly
 
 
 Thanks,
 
 Alex Brett
 




Versions on Jira and web

2014-08-13 Thread Alex Brett
Hello,

I'm not sure who has the power to change this, but in the Apache Jira the 
versions for the CLOUDSTACK project are a bit out of sync with reality - we 
currently incorrectly list the following as unreleased:
4.1.1
4.2.1
4.3.0
4.4.0

Also, on the downloads page (http://cloudstack.apache.org/downloads.html) we 
have 4.4.0, which is correct, however on the linked archives page 
(http://cloudstack.apache.org/archives.html) we don't seem to have 4.3.0, the 
newest release shown is 4.2.1 - have we accidentally lost 4.3.0 when releasing 
4.4.0?

Kind Regards,
Alex Brett


Review Request 24605: CLOUDSTACK-7322 Tag disruptive tests

2014-08-12 Thread Alex Brett

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24605/
---

Review request for cloudstack and Santhosh Edukulla.


Bugs: CLOUDSTACK-7322
https://issues.apache.org/jira/browse/CLOUDSTACK-7322


Repository: cloudstack-git


Description
---

Some tests are disruptive (in that they cannot be run in parallel with other 
tests, as they do disruptive things such as stopping the secondary storage VM). 
This patch adds a disruptive nosetests attribute to those tests which are 
known to be so, such that they can be easily excluded from parallel runs.


Diffs
-

  test/integration/component/maint/test_bugs.py 07e3655 
  test/integration/component/maint/test_egress_rules_host_maintenance.py 
a27ada3 
  test/integration/component/maint/test_high_availability.py cc687f8 
  test/integration/component/maint/test_multiple_ip_ranges.py 982dd7c 
  test/integration/component/maint/test_vpc_host_maintenance.py 83ba271 
  test/integration/component/maint/test_vpc_on_host_maintenance.py eb3360a 
  test/integration/smoke/test_ssvm.py 5713569 

Diff: https://reviews.apache.org/r/24605/diff/


Testing
---

Verified using --collect-only option to nosetests that filtering using the 
disruptive attribute works correctly.


Thanks,

Alex Brett



Review Request 24550: CLOUDSTACK-7306 Don't run test_01_primary_storage_iscsi on KVM or HyperV

2014-08-11 Thread Alex Brett

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24550/
---

Review request for cloudstack and Santhosh Edukulla.


Bugs: CLOUDSTACK-7306
https://issues.apache.org/jira/browse/CLOUDSTACK-7306


Repository: cloudstack-git


Description
---

test_01_primary_storage_iscsi in test/integration/smoke/test_primary_storage.py 
currently attempts to set up an iSCSI primary storage pool, regardless of the 
type of host.

For KVM, we only support iSCSI via shared mount point, and for Hyper-V we don't 
support it at all, so the test should skip in these cases.


Diffs
-

  test/integration/smoke/test_primary_storage.py 66aec59 

Diff: https://reviews.apache.org/r/24550/diff/


Testing
---

Ran test against KVM host to verify it skips correctly


Thanks,

Alex Brett



Review Request 24552: CLOUDSTACK-7307 Add simulator_only attribute to tests which need it

2014-08-11 Thread Alex Brett

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24552/
---

Review request for cloudstack, Gaurav Aradhye and Santhosh Edukulla.


Bugs: CLOUDSTACK-7307
https://issues.apache.org/jira/browse/CLOUDSTACK-7307


Repository: cloudstack-git


Description
---

See full explanation and justification of this patch on the ticket at 
https://issues.apache.org/jira/browse/CLOUDSTACK-7307

A brief summary is that a number of tests require the simulator (e.g. to check 
the behaviour in a failure condition).

The existing attempt at solving this issue involved setting the 
required_hardware attribute to simulator only, however
this is not very easy to use with the nosetests runner due to limitations it 
has around handling attributes. By adding a
new attribute (simulator_only), we can simply add !simulator_only to an 
attribute listing to avoid running these tests.


Diffs
-

  test/integration/smoke/misc/test_deploy_vm.py 071d15d 
  test/integration/smoke/misc/test_vm_ha.py 601354e 
  test/integration/smoke/test_vm_sync.py 6d56945 

Diff: https://reviews.apache.org/r/24552/diff/


Testing
---

Verified that tests are picked up when run without the new attribute, and not 
picked up when used with !simulator_only in the nosetests -a attribute list.


Thanks,

Alex Brett



Review Request 24050: CLOUDSTACK-7173 Make getNewMinIops and getNewMaxIops return Longs

2014-07-29 Thread Alex Brett

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24050/
---

Review request for cloudstack.


Bugs: CLOUDSTACK-7173
https://issues.apache.org/jira/browse/CLOUDSTACK-7173


Repository: cloudstack-git


Description
---

The functions getNewMinIops and getNewMaxIops were returning long primitives, 
this can throw a NPE as the underlying Long objects could be null, which was 
causing volume resizes to fail.

The only place this getter is called is expecting a Long object, so changing it 
to return a Long rather than long should be safe.


Diffs
-

  server/src/com/cloud/storage/VmWorkResizeVolume.java 1caab10 

Diff: https://reviews.apache.org/r/24050/diff/


Testing
---

Verified cloudstack still builds


Thanks,

Alex Brett



RE: Failed add KVM agent to CS with latest master

2014-07-23 Thread Alex Brett
 I am unable to add KVM agent with latest master build,  this issue is tracked
 in https://issues.apache.org/jira/browse/CLOUDSTACK-7170
 
 Those made changes in master yesterday/today, can you please check it
 regressed from you commit or not ?

As noted on the ticket I've narrowed this down to one of the following three 
changesets:

commit 3b32732459730bfd4848678c95c27e2eb653cc04
Author: Min Chen min.c...@citrix.com
Date:   Tue Jul 22 09:47:27 2014 -0700

CLOUDSTACK-7162:queryAsyncJobResult api does not return jobinstanceid.

commit 1d2124dcbf48d15d23ddbdea23a29f0ab21be6f3
Author: Hugo Trippaers htrippa...@schubergphilis.com
Date:   Tue Jul 22 17:43:49 2014 +0200

Fix NPE reported on IRC, provide the user an informative error message

commit 4523490d44160b054de9e943f72db1d0ce06054a
Author: Santhosh Edukulla santhosh.eduku...@gmail.com
Date:   Mon Jul 21 20:49:03 2014 +0530

Fixed Coverity Issues reported

Signed-off-by: Santhosh Edukulla santhosh.eduku...@gmail.com

Alex


Review Request 22512: CLOUDSTACK-6862 Don't run vGPU tests on KVM or in the BVTs

2014-06-12 Thread Alex Brett

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22512/
---

Review request for cloudstack and SrikanteswaraRao Talluri.


Bugs: CLOUDSTACK-6862 and CLOUDSTACK-6876
https://issues.apache.org/jira/browse/CLOUDSTACK-6862
https://issues.apache.org/jira/browse/CLOUDSTACK-6876


Repository: cloudstack-git


Description
---

- Make this test skip if it's not running on a XenServer host (as that's the 
only hypervisor that supports vGPU at present)
- Also remove the tags that make this test run on a BVT, since it will *only* 
work if run on a host with vGPU hardware

See also CLOUDSTACK-6876 - I don't have rights to duplicate these two issues, 
but I believe they are the same thing.


Diffs
-

  test/integration/smoke/test_deploy_vgpu_enabled_vm.py fa33bdc 

Diff: https://reviews.apache.org/r/22512/diff/


Testing
---

Tested against a KVM host to ensure the skip logic kicks in.


Thanks,

Alex Brett



Re: Review Request 22512: CLOUDSTACK-6862 Don't run vGPU tests on KVM or in the BVTs

2014-06-12 Thread Alex Brett


 On June 12, 2014, 3:27 p.m., Santhosh Edukulla wrote:
  test/integration/smoke/test_deploy_vgpu_enabled_vm.py, line 126
  https://reviews.apache.org/r/22512/diff/1/?file=608112#file608112line126
 
  If this is specific to entire module, then its better we move this 
  check to setup class instead and skip.

Which module are you referring to - there isn't a specific vGPU module in 
Marvin as far as I can see, the test just creates a ServiceOffering for VGPU 
with 'pciDevice': 'VGPU' set?


 On June 12, 2014, 3:27 p.m., Santhosh Edukulla wrote:
  test/integration/smoke/test_deploy_vgpu_enabled_vm.py, line 164
  https://reviews.apache.org/r/22512/diff/1/?file=608112#file608112line164
 
  Dont we require other advanced, basic,provisioning tags? Otherwise it 
  may run on non required setups as well.

As I understand it (which is quite liable to be wrong) the tags are OR'd 
together, there's no way of specifying that a specific attribute *must* be 
provided for the test to run.

Only options here therefore are:
1. Ensure the BVTs (and any other run of Marvin tests that's not on VGPU 
hardware) have a !vgpu tag specified
2. Have a separate set of vgpu-advanced, vgpu-basic etc tags


- Alex


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22512/#review45503
---


On June 12, 2014, 1:27 p.m., Alex Brett wrote:
 
 ---
 This is an automatically generated e-mail. To reply, visit:
 https://reviews.apache.org/r/22512/
 ---
 
 (Updated June 12, 2014, 1:27 p.m.)
 
 
 Review request for cloudstack and SrikanteswaraRao Talluri.
 
 
 Bugs: CLOUDSTACK-6862 and CLOUDSTACK-6876
 https://issues.apache.org/jira/browse/CLOUDSTACK-6862
 https://issues.apache.org/jira/browse/CLOUDSTACK-6876
 
 
 Repository: cloudstack-git
 
 
 Description
 ---
 
 - Make this test skip if it's not running on a XenServer host (as that's the 
 only hypervisor that supports vGPU at present)
 - Also remove the tags that make this test run on a BVT, since it will *only* 
 work if run on a host with vGPU hardware
 
 See also CLOUDSTACK-6876 - I don't have rights to duplicate these two issues, 
 but I believe they are the same thing.
 
 
 Diffs
 -
 
   test/integration/smoke/test_deploy_vgpu_enabled_vm.py fa33bdc 
 
 Diff: https://reviews.apache.org/r/22512/diff/
 
 
 Testing
 ---
 
 Tested against a KVM host to ensure the skip logic kicks in.
 
 
 Thanks,
 
 Alex Brett
 




Re: Review Request 22512: CLOUDSTACK-6862 Don't run vGPU tests on KVM or in the BVTs

2014-06-12 Thread Alex Brett

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22512/
---

(Updated June 12, 2014, 5:21 p.m.)


Review request for cloudstack and SrikanteswaraRao Talluri.


Changes
---

Updated patch to fix the first issue


Bugs: CLOUDSTACK-6862 and CLOUDSTACK-6876
https://issues.apache.org/jira/browse/CLOUDSTACK-6862
https://issues.apache.org/jira/browse/CLOUDSTACK-6876


Repository: cloudstack-git


Description
---

- Make this test skip if it's not running on a XenServer host (as that's the 
only hypervisor that supports vGPU at present)
- Also remove the tags that make this test run on a BVT, since it will *only* 
work if run on a host with vGPU hardware

See also CLOUDSTACK-6876 - I don't have rights to duplicate these two issues, 
but I believe they are the same thing.


Diffs (updated)
-

  test/integration/smoke/test_deploy_vgpu_enabled_vm.py fa33bdc 

Diff: https://reviews.apache.org/r/22512/diff/


Testing
---

Tested against a KVM host to ensure the skip logic kicks in.


Thanks,

Alex Brett



Re: Review Request 22512: CLOUDSTACK-6862 Don't run vGPU tests on KVM or in the BVTs

2014-06-12 Thread Alex Brett


 On June 12, 2014, 3:56 p.m., Santhosh Edukulla wrote:
  test/integration/smoke/test_deploy_vgpu_enabled_vm.py, line 164
  https://reviews.apache.org/r/22512/diff/1/?file=608112#file608112line164
 
  We have to get nose tests discovery for that. We dont have a case for 
  vgpu. 
  EX: A tag of advanced,means we want all advanced zone test cases, then 
  this test case will as well be picked up otherwise wont if not tagged. 
  Similarly, we can do and or with tags values provided separately.

Sorry I don't quite follow you - this test is running in the BVTs at the moment 
because it is being picked up by the 'basic' and 'advanced' tags, but as 
there's no vGPU hardware in use it would never work.

I suppose we could modify the test to skip if it's not running on vGPU 
hardware, but that's quite difficult to detect...


- Alex


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22512/#review45510
---


On June 12, 2014, 5:21 p.m., Alex Brett wrote:
 
 ---
 This is an automatically generated e-mail. To reply, visit:
 https://reviews.apache.org/r/22512/
 ---
 
 (Updated June 12, 2014, 5:21 p.m.)
 
 
 Review request for cloudstack and SrikanteswaraRao Talluri.
 
 
 Bugs: CLOUDSTACK-6862 and CLOUDSTACK-6876
 https://issues.apache.org/jira/browse/CLOUDSTACK-6862
 https://issues.apache.org/jira/browse/CLOUDSTACK-6876
 
 
 Repository: cloudstack-git
 
 
 Description
 ---
 
 - Make this test skip if it's not running on a XenServer host (as that's the 
 only hypervisor that supports vGPU at present)
 - Also remove the tags that make this test run on a BVT, since it will *only* 
 work if run on a host with vGPU hardware
 
 See also CLOUDSTACK-6876 - I don't have rights to duplicate these two issues, 
 but I believe they are the same thing.
 
 
 Diffs
 -
 
   test/integration/smoke/test_deploy_vgpu_enabled_vm.py fa33bdc 
 
 Diff: https://reviews.apache.org/r/22512/diff/
 
 
 Testing
 ---
 
 Tested against a KVM host to ensure the skip logic kicks in.
 
 
 Thanks,
 
 Alex Brett
 




Re: Review Request 22232: Fix for test_01_create_volume to use the correct volume name for KVM

2014-06-10 Thread Alex Brett

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/22232/
---

(Updated June 10, 2014, 10:09 a.m.)


Review request for cloudstack and SrikanteswaraRao Talluri.


Changes
---

Adding cloudstack group


Repository: cloudstack-git


Description
---

test_01_create_volume was expecting the new volume to appears as /dev/sda when 
running on KVM (as this is the default volume used in util.checkVolumeSize), 
whereas it actually appears as /dev/vdb.

This patch determines the appropriate volume name in the same way as we do for 
XenServer, and uses that instead.


Diffs
-

  test/integration/smoke/test_volumes.py 73c2722 

Diff: https://reviews.apache.org/r/22232/diff/


Testing
---

Verified the test now passes when running against a KVM host.


Thanks,

Alex Brett